Pinned Loading

1. ScaleLLM ScaleLLM Public

   Forked from vectorch-ai/ScaleLLM

   A high-performance inference system for large language models, designed for production environments.

   C++

2. DeepRec DeepRec Public

   Forked from DeepRec-AI/DeepRec

   DeepRec is a recommendation engine based on TensorFlow.

   C++

3. vllm vllm Public

   Forked from vllm-project/vllm

   A high-throughput and memory-efficient inference and serving engine for LLMs

   Python