Open-source LLM/VLM load balancer and serving platform for self-hosting LLMs (and VLMs) at scale 🏓🦙 Alternative to projects like llm-d, Docker Model Runner, etc but with less moving parts and simple deployments built around ggml ecosystem. Runs on CPU and GPU.
Quick read
Latest capture 2026-08-11 04:25
32 paths
Agent instructions and tool configuration found in this repository.
Claude Code 32
8 more paths detected.
64 observed captures since 2026-06-02. Observed captures are shown by default.
Stars from first capture +67
Observed captures only
All tracked data
Observed snapshots
Observed snapshots
Nearest indexed repositories by embedding similarity.
A self-hosted, offline, ChatGPT-like chatbot. Powered by Llama 2. 100% private, with no data leaving your device. New: Code Llama support!
LocalAI is the open-source AI engine. Run any model - LLMs, vision, voice, image, video - on any hardware. No GPU required.
Achieve state of the art inference performance with modern accelerators on Kubernetes
Low-code framework for building custom LLMs, neural networks, and other AI models
LLM inference in C/C++
AirLLM 70B inference with single 4GB GPU
