ggml-org/llama.cpp
LLM inference in C/C++
113297 stars
C++
2 awesome lists
kaito-project/aikit
🏗️ Fine-tune, build, and deploy open-source LLMs easily!
- Stars
- 524
- Forks
- 57
- Commits
- —
- Language
- Go
- Awesome lists
- 2
Similar repositories
getumbrel/llama-gpt
A self-hosted, offline, ChatGPT-like chatbot. Powered by Llama 2. 100% private, with no data leaving your device. New: Code Llama support!
10961 stars
TypeScript
3 awesome lists
NVIDIA/Model-Optimizer
A unified library of SOTA model optimization techniques like quantization, pruning, distillation, speculative decoding, etc. It compresses deep learning models for downstream deployment frameworks like TensorRT-LLM, TensorRT, vLLM, etc. to optimize inference speed.
2759 stars
Python
1 awesome list
LostRuins/koboldcpp
Run GGUF models easily with a KoboldAI UI. One File. Zero Install.
10613 stars
C++
1 awesome list
hiyouga/LlamaFactory
Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)
71580 stars
Python
1 awesome list
mudler/LocalAI
LocalAI is the open-source AI engine. Run any model - LLMs, vision, voice, image, video - on any hardware. No GPU required.
46491 stars
Go
5 awesome lists
Tracked growth
1 capture since 2026-05-27
Latest capture 2026-05-27 12:44
Stars history
Total starsCommits history
Default branch commitsMetadata
- Created: 2023-09-20
- First commit: —
- Last pushed: 2026-05-25
- Website: https://kaito-project.github.io/aikit/
- Archived: no
- Stack detected: —
- License: MIT
AI development signals
No AI development config files detected.