sgl-project/sglang
SGLang is a high-performance serving framework for large language models and multimodal models.
28241 stars
Python
4 awesome lists
sgl-project/mini-sglang
A compact implementation of SGLang, designed to demystify the complexities of modern LLM serving systems.
- Stars
- 4,280
- Forks
- 670
- Commits
- 171
- Language
- Python
- Awesome lists
- 1
Similar repositories
EleutherAI/lm-evaluation-harness
A framework for few-shot evaluation of language models.
12684 stars
Python
4 awesome lists
ggml-org/llama.cpp
LLM inference in C/C++
113297 stars
C++
2 awesome lists
QwenLM/Qwen3.6
Qwen3.6 is the large language model series developed by Qwen team, Alibaba Group.
3431 stars
1 awesome list
Lightning-AI/LitServe
A minimal Python framework for building custom AI inference servers with full control over logic, batching, and scaling.
3883 stars
Python
1 awesome list
THUDM/slime
slime is an LLM post-training framework for RL Scaling.
5775 stars
Python
1 awesome list
Tracked growth
1 capture since 2026-05-25
Latest capture 2026-05-25 21:17
Stars history
Total starsCommits history
Default branch commitsMetadata
- Created: 2025-09-01
- First commit: —
- Last pushed: 2026-05-17
- Archived: no
- Stack detected: —
- License: MIT
AI development signals
No AI development config files detected.