vllm-project/vllm
A high-throughput and memory-efficient inference and serving engine for LLMs
81308 stars
Python
3 awesome lists
ModelTC/LightLLM
LightLLM is a Python-based LLM (Large Language Model) inference and serving framework, notable for its lightweight design, easy scalability, and high-speed performance.
- Stars
- 4,077
- Forks
- 330
- Commits
- 844
- Language
- Python
- Awesome lists
- 1
Similar repositories
rllm-org/rllm
Democratizing Reinforcement Learning for LLMs
5563 stars
Python
1 awesome list
jd-opensource/xllm
A high-performance inference engine for LLM, VLM, DiT and REC models, optimized for diverse AI accelerators.
1300 stars
C++
1 awesome list
OptimalScale/LMFlow
An Extensible Toolkit for Finetuning and Inference of Large Foundation Models. Large Models for All.
8486 stars
Python
2 awesome lists
mlc-ai/mlc-llm
Universal LLM Deployment Engine with ML Compilation
22709 stars
Python
1 awesome list
llm-d/llm-d
Achieve state of the art inference performance with modern accelerators on Kubernetes
3250 stars
Shell
1 awesome list
Tracked growth
1 capture since 2026-05-25
Latest capture 2026-05-25 21:09
Stars history
Total starsCommits history
Default branch commitsMetadata
- Created: 2023-07-22
- First commit: —
- Last pushed: 2026-05-25
- Archived: no
- Stack detected: —
- License: Apache-2.0
AI development signals
No AI development config files detected.