UbiquitousLearning/mllm
Fast Multimodal LLM on Mobile Devices
1521 stars
C++
1 awesome list
mlc-ai/mlc-llm
Universal LLM Deployment Engine with ML Compilation
- Stars
- 22,709
- Forks
- 2,056
- Commits
- 1799
- Language
- Python
- Awesome lists
- 1
Similar repositories
InternLM/lmdeploy
LMDeploy is a toolkit for compressing, deploying, and serving LLMs.
7873 stars
Python
2 awesome lists
vllm-project/vllm
A high-throughput and memory-efficient inference and serving engine for LLMs
81308 stars
Python
3 awesome lists
jd-opensource/xllm
A high-performance inference engine for LLM, VLM, DiT and REC models, optimized for diverse AI accelerators.
1300 stars
C++
1 awesome list
ml-explore/mlx
MLX: An array framework for Apple silicon
26434 stars
C++
2 awesome lists
llm-d/llm-d
Achieve state of the art inference performance with modern accelerators on Kubernetes
3250 stars
Shell
1 awesome list
Tracked growth
1 capture since 2026-05-25
Latest capture 2026-05-25 21:09
Stars history
Total starsCommits history
Default branch commitsMetadata
- Created: 2023-04-29
- First commit: —
- Last pushed: 2026-05-11
- Website: https://llm.mlc.ai/
- Archived: no
- Stack detected: —
- License: Apache-2.0
AI development signals
No AI development config files detected.