jd-opensource/xllm
A high-performance inference engine for LLM, VLM, DiT and REC models, optimized for diverse AI accelerators.
1300 stars
C++
1 awesome list
mlc-ai/xgrammar
Fast, Flexible and Portable Structured Generation
- Stars
- 1,702
- Forks
- 149
- Commits
- 442
- Language
- C++
- Awesome lists
- 1
Similar repositories
mlc-ai/mlc-llm
Universal LLM Deployment Engine with ML Compilation
22709 stars
Python
1 awesome list
sgl-project/sglang
SGLang is a high-performance serving framework for large language models and multimodal models.
28241 stars
Python
4 awesome lists
rllm-org/rllm
Democratizing Reinforcement Learning for LLMs
5563 stars
Python
1 awesome list
microsoft/LLMLingua
[EMNLP'23, ACL'24] To speed up LLMs' inference and enhance LLM's perceive of key information, compress the prompt and KV-Cache, which achieves up to 20x compression with minimal performance loss.
6228 stars
Python
1 awesome list
THUDM/slime
slime is an LLM post-training framework for RL Scaling.
5775 stars
Python
1 awesome list
Tracked growth
1 capture since 2026-05-25
Latest capture 2026-05-25 21:09
Stars history
Total starsCommits history
Default branch commitsMetadata
- Created: 2024-06-28
- First commit: —
- Last pushed: 2026-05-20
- Website: https://xgrammar.mlc.ai/docs
- Archived: no
- Stack detected: —
- License: Apache-2.0
AI development signals
No AI development config files detected.