deepspeedai

All

6 repositories

DeepSpeedExamples
Public
Example models using DeepSpeed
Python
•
Apache License 2.0
•1.1k•6.6k•297•22•Updated Aug 16, 2025Aug 16, 2025
DeepSpeed
Public
DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.
compression inference zero data-parallelism model-parallelism mixture-of-experts pipeline-parallelism billion-parameters trillion-parameters machine-learning
Python
•
Apache License 2.0
•4.5k•40k•1.1k•104•Updated Aug 16, 2025Aug 16, 2025
Megatron-DeepSpeed
Public
Ongoing research training transformer language models at scale, including: BERT & GPT-2
Python
•
Other
•3k•2.1k•137•19•Updated Aug 14, 2025Aug 14, 2025
DeepSpeed-MII
Public
MII makes low-latency and high-throughput inference possible, powered by DeepSpeed.
inference deep-learning pytorch
Python
•
Apache License 2.0
•187•2k•199•11•Updated Jun 30, 2025Jun 30, 2025
DeepSpeed-Kernels
Public
C++
•
Apache License 2.0
•16•74•1•0•Updated Mar 26, 2025Mar 26, 2025
deepspeed-gpt-neox
Public
An implementation of model parallel autoregressive transformers on GPUs, based on the DeepSpeed library.
Python
•
Apache License 2.0
•1.1k•23•0•1•Updated Nov 28, 2022Nov 28, 2022