🚀 Accelerate inference and training of 🤗 Transformers, Diffusers, TIMM and Sentence Transformers with easy to use hardware optimization tools
A unified library of SOTA model optimization techniques like quantization, pruning, distillation, speculative decoding, etc. It compresses deep learning models for downstream deployment frameworks like TensorRT-LLM, TensorRT, vLLM, etc. to optimize inference speed.
🚀 A simple way to launch, train, and use PyTorch models on almost any device and distributed configuration, automatic mixed precision (including fp8), and easy-to-configure FSDP and DeepSpeed support
An implementation of model parallel autoregressive transformers on GPUs, based on the Megatron and DeepSpeed libraries
Minimalistic large language model 3D-parallelism training
🏗️ Fine-tune, build, and deploy open-source LLMs easily!
DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.
1 capture since 2026-05-25
