NVIDIA/Megatron-LM
Ongoing research training transformer models at scale
DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.
Appears on
Quick read
Latest capture 2026-08-03 03:07
7 observed captures since 2026-05-25. Observed captures are shown by default.
Stars from first capture +454
Observed captures only
All tracked data
Observed snapshots
Observed snapshots
Nearest indexed repositories by embedding similarity.
Ongoing research training transformer models at scale
Making large AI models cheaper, faster and more accessible
Data processing for and with foundation models! 🍎 🍋 🌽 ➡️ ➡️🍸 🍹 🍷
Minimalistic large language model 3D-parallelism training
A Next-Generation Training Engine Built for Ultra-Large MoE Models
An implementation of model parallel autoregressive transformers on GPUs, based on the Megatron and DeepSpeed libraries