Popular repositories Loading

1. transformers transformers Public

   Forked from huggingface/transformers

   🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.

   Python 1

2. vllm vllm Public

   Forked from vllm-project/vllm

   A high-throughput and memory-efficient inference and serving engine for LLMs

   Python 1

3. FasterTransformer FasterTransformer Public

   Forked from NVIDIA/FasterTransformer

   Transformer related optimization, including BERT, GPT

   C++

4. serve serve Public

   Forked from pytorch/serve

   Serve, optimize and scale PyTorch models in production

   Java

5. server server Public

   Forked from triton-inference-server/server

   The Triton Inference Server provides an optimized cloud and edge inferencing solution.

   Python

6. helm helm Public

   Forked from stanford-crfm/helm

   Holistic Evaluation of Language Models (HELM), a framework to increase the transparency of language models (https://arxiv.org/abs/2211.09110).

   Python