Repository profile
Open-source LLM/VLM load balancer and serving platform for self-hosting LLMs (and VLMs) at scale 🏓🦙 Alternative to projects like llm-d, Docker Model Runner, etc but with less moving parts and simple deployments built around ggml ecosystem. Runs on CPU and GPU.
Repository updates
Get generated intentee/paddler development summaries by email, or follow the weekly and monthly RSS feeds.
Sign in to subscribe by email. RSS feeds are public.
Sign in to subscribeTracked growth, recent movement, and commit velocity from stored repository snapshots.
Latest capture 2026-07-18 04:23
47 captures since 2026-06-02
Stars from baseline +53
All tracked data
Frameworks, package managers, ecosystems, and dependency manifests found during catalog scans.
Scanned 2026-07-18 04:23
Cargo.toml
rust ecosystem,
76 dependencies
package.json
javascript ecosystem,
32 dependencies
Cargo.lock
rust ecosystem,
751 dependencies
package-lock.json
javascript ecosystem,
494 dependencies
paddler_agent/Cargo.toml
rust ecosystem,
40 dependencies
paddler_balancer/Cargo.toml
rust ecosystem,
35 dependencies
paddler_bootstrap/Cargo.toml
rust ecosystem,
13 dependencies
paddler_cache_dir/Cargo.toml
rust ecosystem,
6 dependencies
Searchable topics, generated tags, and stack labels that explain where this repository fits.
Agent instructions and tool configuration paths found in the repository tree.
AI agent config detected
Showing the first 24 paths. 8 more detected.
Nearest indexed repositories by embedding similarity.
A self-hosted, offline, ChatGPT-like chatbot. Powered by Llama 2. 100% private, with no data leaving your device. New: Code Llama support!
LocalAI is the open-source AI engine. Run any model - LLMs, vision, voice, image, video - on any hardware. No GPU required.
Achieve state of the art inference performance with modern accelerators on Kubernetes
Low-code framework for building custom LLMs, neural networks, and other AI models
📊 llm.report is an open-source logging and analytics platform for OpenAI: Log your ChatGPT API requests, analyze costs, and improve your prompts.
Run any open-source LLMs, such as DeepSeek and Llama, as OpenAI compatible API endpoint in the cloud.
