vllm-project/vllm
A high-throughput and memory-efficient inference and serving engine for LLMs
81308 stars
Python
3 awesome lists
- Stars
- 13,646
- Forks
- 2,139
- Commits
- 67
- Language
- Python
- Awesome lists
- 1
Similar repositories
huggingface/nanotron
Minimalistic large language model 3D-parallelism training
2699 stars
Python
2 awesome lists
UbiquitousLearning/mllm
Fast Multimodal LLM on Mobile Devices
1521 stars
C++
1 awesome list
open-compass/VLMEvalKit
Open-source evaluation toolkit of large multi-modality models (LMMs), support 220+ LMMs, 80+ benchmarks
4151 stars
Python
2 awesome lists
sgl-project/mini-sglang
A compact implementation of SGLang, designed to demystify the complexities of modern LLM serving systems.
4280 stars
Python
1 awesome list
NVlabs/VILA
VILA is a family of state-of-the-art vision language models (VLMs) for diverse multimodal AI tasks across the edge, data center, and cloud.
3799 stars
Python
1 awesome list
Tracked growth
1 capture since 2026-05-25
Latest capture 2026-05-25 20:58
Stars history
Total starsCommits history
Default branch commitsMetadata
- Created: 2025-06-09
- First commit: —
- Last pushed: 2026-04-26
- Archived: no
- Stack detected: —
- License: MIT
AI development signals
No AI development config files detected.