Repository profile
Ongoing research training transformer models at scale
Repository updates
Get generated NVIDIA/Megatron-LM development summaries by email, or follow the weekly and monthly RSS feeds.
Sign in to subscribe by email. RSS feeds are public.
Sign in to subscribeTracked growth, recent movement, and commit velocity from stored repository snapshots.
Latest capture 2026-07-15 03:15
5 captures since 2026-05-25
Stars from baseline +624
All tracked data
Frameworks, package managers, ecosystems, and dependency manifests found during catalog scans.
Scanned 2026-07-15 03:15
pyproject.toml
python ecosystem,
0 dependencies
setup.py
python ecosystem,
0 dependencies
uv.lock
python ecosystem,
0 dependencies
docker/lts/requirements.txt
python ecosystem,
0 dependencies
megatron/core/requirements.txt
python ecosystem,
0 dependencies
examples/post_training/modelopt/requirements.txt
python ecosystem,
0 dependencies
megatron/core/distributed/fsdp/src/pyproject.toml
python ecosystem,
0 dependencies
Searchable topics, generated tags, and stack labels that explain where this repository fits.
Agent instructions and tool configuration paths found in the repository tree.
AI agent config detected
Key config paths
Nearest indexed repositories by embedding similarity.
Minimalistic large language model 3D-parallelism training
A unified library of SOTA model optimization techniques like quantization, distillation, pruning, neural architecture search, speculative decoding, etc. It compresses deep learning models for downstream deployment frameworks like TensorRT-LLM, TensorRT, vLLM, etc. to optimize inference speed.
A Next-Generation Training Engine Built for Ultra-Large MoE Models
A Flexible Framework for Experiencing Heterogeneous LLM Inference/Fine-tune Optimizations
DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.
Go ahead and axolotl questions
https://docs.nvidia.com/megatron-core/developer-guide/latest/get-started/quickstart.html
README403 Forbidden | https://api.github.com/repos/NVIDIA/Megatron-LM/readme | message=API rate limit exceeded for user ID 260990068. If you reach out to GitHub Support for help, please include the request ID E936:260987:D04909E:C558A3B:6A56FB3B and timestamp 2026-07-15 03:15:07 UTC. For more on scraping GitHub and how it may affect your rights, please review our Terms of Service (htt | rate_limit_remaining=0 | rate_limit_reset=1784088007
