Sign in
← Back to search

intentee/paddler

Open-source LLM/VLM load balancer and serving platform for self-hosting LLMs (and VLMs) at scale 🏓🦙 Alternative to projects like llm-d, Docker Model Runner, etc but with less moving parts and simple deployments built around ggml ecosystem. Runs on CPU and GPU.

Stars
1,586
Forks
90
Commits
1102
Language
Rust
Awesome lists
0

Similar repositories

getumbrel/llama-gpt

A self-hosted, offline, ChatGPT-like chatbot. Powered by Llama 2. 100% private, with no data leaving your device. New: Code Llama support!

10961 stars
TypeScript 3 awesome lists

llm-d/llm-d

Achieve state of the art inference performance with modern accelerators on Kubernetes

3250 stars
Shell 1 awesome list

mudler/LocalAI

LocalAI is the open-source AI engine. Run any model - LLMs, vision, voice, image, video - on any hardware. No GPU required.

46491 stars
Go 5 awesome lists

ludwig-ai/ludwig

Low-code framework for building custom LLMs, neural networks, and other AI models

11705 stars
Python 2 awesome lists

dillionverma/llm.report

📊 llm.report is an open-source logging and analytics platform for OpenAI: Log your ChatGPT API requests, analyze costs, and improve your prompts.

1020 stars
TypeScript 2 awesome lists

Tracked growth

2 captures since 2026-06-02

Latest capture 2026-06-03 04:18

Stars history

Total stars

Commits history

Default branch commits

Detected stack

Frameworks and tools

  • Actix Web · web framework · high confidence
  • pytest · test framework · high confidence
  • React · frontend framework · high confidence
Cargo npm Poetry

Dependency files

  • Cargo.toml · rust · 67 dependencies
  • package.json · javascript · 32 dependencies
  • Cargo.lock · rust · 774 dependencies
  • package-lock.json · javascript · 494 dependencies
  • paddler/Cargo.toml · rust · 50 dependencies
  • paddler_bootstrap/Cargo.toml · rust · 11 dependencies
  • paddler_cache_dir/Cargo.toml · rust · 6 dependencies
  • paddler_cli/Cargo.toml · rust · 15 dependencies
  • paddler_client/Cargo.toml · rust · 14 dependencies
  • paddler_client_cli/Cargo.toml · rust · 17 dependencies

Metadata

  • Created: 2024-04-27
  • First commit: 2024-04-27
  • Last pushed: 2026-06-03
  • Website: https://paddler.intentee.com
  • Archived: no
  • Stack detected: 2026-06-03 04:18
  • License: Apache-2.0

AI development signals

AI agent config detected

16 config paths 12 files 4 directories
Claude Code 16

Key config paths

  • dir .claude
  • file CLAUDE.md
Review config paths
  • Claude Code .claude
  • Claude Code .claude/.gitignore
  • Claude Code .claude/rules
  • Claude Code .claude/rules/code-style.md
  • Claude Code .claude/rules/commits.md
  • Claude Code .claude/rules/github-workflows.md
  • Claude Code .claude/rules/makefile.md
  • Claude Code .claude/rules/python-on-nixos.md
  • Claude Code .claude/rules/rust-integration-tests.md
  • Claude Code .claude/rules/rust.md
  • Claude Code .claude/rules/teamwork.md
  • Claude Code .claude/rules/testing.md
  • Claude Code .claude/skills
  • Claude Code .claude/skills/running-all-tests
  • Claude Code .claude/skills/running-all-tests/SKILL.md
  • Claude Code CLAUDE.md

Appears in

  • No awesome list links recorded.