ggml-org/llama.cpp
LLM inference in C/C++
113297 stars
C++
2 awesome lists
mostlygeek/llama-swap
Reliable model swapping for any local OpenAI/Anthropic compatible server - llama.cpp, vllm, etc
- Stars
- 4,259
- Forks
- 329
- Commits
- 471
- Language
- Go
- Awesome lists
- 2
Similar repositories
ikawrakow/ik_llama.cpp
llama.cpp fork with additional SOTA quants and improved performance
2579 stars
C++
1 awesome list
getumbrel/llama-gpt
A self-hosted, offline, ChatGPT-like chatbot. Powered by Llama 2. 100% private, with no data leaving your device. New: Code Llama support!
10961 stars
TypeScript
3 awesome lists
gotzmann/llama.go
llama.go is like llama.cpp in pure Golang!
1403 stars
Go
2 awesome lists
defilantech/LLMKube
Kubernetes operator for local LLM inference with llama.cpp, vLLM, TGI, and mlx-server — multi-GPU NVIDIA + Apple Silicon Metal, autoscaling, air-gapped, production-ready
112 stars
Go
1 awesome list
b4rtaz/distributed-llama
Distributed LLM inference. Connect home devices into a powerful cluster to accelerate LLM inference. More devices means faster inference.
2944 stars
C++
1 awesome list
Tracked growth
1 capture since 2026-05-25
Latest capture 2026-05-25 21:09
Stars history
Total starsCommits history
Default branch commitsMetadata
- Created: 2024-10-04
- First commit: —
- Last pushed: 2026-05-25
- Archived: no
- Stack detected: —
- License: MIT
AI development signals
AI agent config detected
3 config paths
3 files
0 directories
Agent instructions
Claude Code
CodeRabbit
Key config paths
-
file
.coderabbit.yaml -
file
AGENTS.md -
file
CLAUDE.md