Pinned Loading

1. vllm-project/aibrix vllm-project/aibrix Public

   Cost-efficient and pluggable Infrastructure components for GenAI inference

   Go 4k 425

2. ai-dynamo/dynamo ai-dynamo/dynamo Public

   A Datacenter Scale Distributed Inference Serving Framework

   Rust 4.7k 530

3. nicholassm/disruptor-rs nicholassm/disruptor-rs Public

   Low latency inter-thread communication library in Rust inspired by the LMAX Disruptor.

   Rust 751 27

4. sgl-project/sglang sgl-project/sglang Public

   SGLang is a fast serving framework for large language models and vision language models.

   Python 16.9k 2.6k

5. nano-vllm nano-vllm Public

   Forked from GeeeekExplorer/nano-vllm

   Nano vLLM

   Python

6. tokasaurus tokasaurus Public

   Forked from ScalingIntelligence/tokasaurus

   Python