NVIDIA/Megatron-LM
Ongoing research training transformer models at scale
Repository profile
Minimalistic large language model 3D-parallelism training
Repository updates
Get generated huggingface/nanotron development summaries by email, or follow the weekly and monthly RSS feeds.
Sign in to subscribe by email. RSS feeds are public.
Sign in to subscribeTracked growth, recent movement, and commit velocity from stored repository snapshots.
Latest capture 2026-07-15 03:13
5 captures since 2026-05-25
Stars from baseline +48
All tracked data
Frameworks, package managers, ecosystems, and dependency manifests found during catalog scans.
Scanned 2026-07-15 03:13
pyproject.toml
python ecosystem,
0 dependencies
examples/doremi/requirements.txt
python ecosystem,
0 dependencies
examples/llama/requirements.txt
python ecosystem,
0 dependencies
examples/mamba/requirements.txt
python ecosystem,
0 dependencies
examples/moe/requirements.txt
python ecosystem,
0 dependencies
Searchable topics, generated tags, and stack labels that explain where this repository fits.
Agent instructions and tool configuration paths found in the repository tree.
AI agent config detected
Key config paths
Nearest indexed repositories by embedding similarity.
Ongoing research training transformer models at scale
A unified library of SOTA model optimization techniques like quantization, distillation, pruning, neural architecture search, speculative decoding, etc. It compresses deep learning models for downstream deployment frameworks like TensorRT-LLM, TensorRT, vLLM, etc. to optimize inference speed.
The best ChatGPT that $100 can buy.
A Next-Generation Training Engine Built for Ultra-Large MoE Models
🦖 X—LLM: Cutting Edge & Easy LLM Finetuning
A PyTorch native platform for training generative AI models
403 Forbidden | https://api.github.com/repos/huggingface/nanotron/readme | message=API rate limit exceeded for user ID 260990068. If you reach out to GitHub Support for help, please include the request ID E548:15C0C8:D4584CB:C97451C:6A56FAC8 and timestamp 2026-07-15 03:13:12 UTC. For more on scraping GitHub and how it may affect your rights, please review our Terms of Service (htt | rate_limit_remaining=0 | rate_limit_reset=1784088007