ggml-org/llama.cpp
LLM inference in C/C++
113297 stars
C++
2 awesome lists
- Stars
- 5,455
- Forks
- 717
- Commits
- 828
- Language
- Python
- Awesome lists
- 1
Similar repositories
eth-sri/lmql
A language for constraint-guided and efficient LLM programming.
4184 stars
Python
2 awesome lists
UbiquitousLearning/mllm
Fast Multimodal LLM on Mobile Devices
1521 stars
C++
1 awesome list
FMInference/FlexLLMGen
Running large language models on a single GPU for throughput-oriented scenarios.
9367 stars
Python
1 awesome list
turboderp-org/exllamav2
A fast inference library for running LLMs locally on modern consumer-class GPUs
4534 stars
Python
1 awesome list
EleutherAI/lm-evaluation-harness
A framework for few-shot evaluation of language models.
12684 stars
Python
4 awesome lists
Tracked growth
4 captures since 2026-05-22
Latest capture 2026-05-29 03:03
Stars history
Total starsCommits history
Default branch commitsMetadata
- Created: 2025-03-11
- First commit: 2023-11-28
- Last pushed: 2026-05-26
- Archived: no
- Stack detected: —
- License: MIT
AI development signals
No AI development config files detected.