Sign in
← Back to search

ai-dynamo/dynamo

A Datacenter Scale Distributed Inference Serving Framework

AxumCobraFastAPIgRPC Gopytest
Sign in to like ai-dynamo/dynamo Open website Open GitHub
Stars
7,173
Forks
1,196
Commits
5349
Language
Rust
Awesome lists
1

Similar repositories

llm-d/llm-d

Achieve state of the art inference performance with modern accelerators on Kubernetes

3250 stars
Shell 1 awesome list

ludwig-ai/ludwig

Low-code framework for building custom LLMs, neural networks, and other AI models

11705 stars
Python 2 awesome lists

pytorch/ignite

High-level library to help with training and evaluating neural networks in PyTorch flexibly and transparently.

4760 stars
Python 2 awesome lists

defilantech/LLMKube

Kubernetes operator for local LLM inference with llama.cpp, vLLM, TGI, and mlx-server — multi-GPU NVIDIA + Apple Silicon Metal, autoscaling, air-gapped, production-ready

112 stars
Go 1 awesome list

kserve/kserve

Standardized Distributed Generative and Predictive AI Inference Platform for Scalable, Multi-Framework Deployment on Kubernetes

5504 stars
Go 1 awesome list

NVIDIA/Model-Optimizer

A unified library of SOTA model optimization techniques like quantization, pruning, distillation, speculative decoding, etc. It compresses deep learning models for downstream deployment frameworks like TensorRT-LLM, TensorRT, vLLM, etc. to optimize inference speed.

2759 stars
Python 1 awesome list

Tracked growth

2 captures since 2026-05-25

Latest capture 2026-06-03 03:05

Stars history

Total stars

Commits history

Default branch commits

Detected stack

Frameworks and tools

  • Axum · web framework · high confidence
  • Cobra · cli framework · high confidence
  • FastAPI · web framework · high confidence
  • gRPC Go · rpc framework · high confidence
  • pytest · test framework · high confidence
Cargo Go modules npm PEP 517 pip uv

Dependency files

  • Cargo.toml · rust · 82 dependencies
  • pyproject.toml · python · 36 dependencies
  • Cargo.lock · rust · 833 dependencies
  • benchmarks/pyproject.toml · python · 11 dependencies
  • .github/scripts/package.json · javascript · 2 dependencies
  • deploy/operator/go.mod · go · 110 dependencies
  • deploy/snapshot/go.mod · go · 110 dependencies
  • deploy/utils/requirements.txt · python · 10 dependencies
  • lib/backend-common/Cargo.toml · rust · 18 dependencies
  • lib/bench/Cargo.toml · rust · 26 dependencies

Metadata

AI development signals

AI agent config detected

58 config paths 43 files 15 directories
Agent instructions 8 Agent workspace 29 Claude Code 20 CodeRabbit

Key config paths

  • dir .agents
  • dir .claude
  • file .coderabbit.yaml
  • file components/src/dynamo/common/backend/CLAUDE.md
  • file components/src/dynamo/sglang/AGENTS.md
  • file components/src/dynamo/sglang/CLAUDE.md

23 more config paths detected.

Review config paths
  • Agent workspace .agents
  • Agent workspace .agents/contributor-skills
  • Agent workspace .agents/contributor-skills/debug-session
  • Agent workspace .agents/contributor-skills/debug-session/SKILL.md
  • Agent workspace .agents/contributor-skills/dep-create
  • Agent workspace .agents/contributor-skills/dep-create/SKILL.md
  • Agent workspace .agents/contributor-skills/dep-status
  • Agent workspace .agents/contributor-skills/dep-status/SKILL.md
  • Agent workspace .agents/contributor-skills/dep-update
  • Agent workspace .agents/contributor-skills/dep-update/SKILL.md
  • Agent workspace .agents/contributor-skills/dynamo-clone-hotpath-audit
  • Agent workspace .agents/contributor-skills/dynamo-clone-hotpath-audit/scripts
  • Agent workspace .agents/contributor-skills/dynamo-clone-hotpath-audit/scripts/clone_inventory.py
  • Agent workspace .agents/contributor-skills/dynamo-clone-hotpath-audit/SKILL.md
  • Agent workspace .agents/contributor-skills/dynamo-docs
  • Agent workspace .agents/contributor-skills/dynamo-docs/SKILL.md
  • Agent workspace .agents/contributor-skills/gh-issue-bug
  • Agent workspace .agents/contributor-skills/gh-issue-bug/SKILL.md
  • Agent workspace .agents/contributor-skills/graham-code-review
  • Agent workspace .agents/contributor-skills/graham-code-review/SKILL.md
  • Agent workspace .agents/contributor-skills/pr-monitor
  • Agent workspace .agents/contributor-skills/pr-monitor/SKILL.md
  • Agent workspace .agents/contributor-skills/tool-parser-generator
  • Agent workspace .agents/contributor-skills/tool-parser-generator/README.md

Showing the first 24 paths. 34 more detected.