BerriAI/litellm
Python SDK, Proxy Server (AI Gateway) to call 100+ LLM APIs in OpenAI (or native) format, with cost tracking, guardrails, loadbalancing and logging. [Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic, Sagemaker, HuggingFace, VLLM, NVIDIA NIM]
FastAPILangChainNext.jspytestReactStarletteTailwind CSSVite
#ai-gateway#anthropic#azure-openai#bedrock#gateway#langchain#litellm#llm#llm-gateway#llmops#mcp-gateway#openai#openai-proxy#vertex-ai
- Stars
- 48,993
- Forks
- 8,542
- Commits
- 39491
- Language
- Python
- Awesome lists
- 7
Tracked growth
8 captures since 2026-05-23
Latest capture 2026-06-02 07:04
Stars history
Total starsCommits history
Default branch commitsDetected stack
Frameworks and tools
- FastAPI · web framework · high confidence
- LangChain · ai framework · high confidence
- Next.js · web framework · high confidence
- pytest · test framework · high confidence
- React · frontend framework · high confidence
- Starlette · web framework · high confidence
- Tailwind CSS · css framework · high confidence
- Vite · build tool · high confidence
Bundler
Go modules
npm
pip
uv
Dependency files
-
package.json· javascript · 7 dependencies -
pyproject.toml· python · 129 dependencies -
package-lock.json· javascript · 390 dependencies -
uv.lock· python · 0 dependencies -
enterprise/pyproject.toml· python · 1 dependencies -
litellm-proxy-extras/pyproject.toml· python · 1 dependencies -
cookbook/anthropic_agent_sdk/requirements.txt· python · 2 dependencies -
cookbook/gollem_go_agent_framework/go.mod· go · 1 dependencies -
cookbook/litellm-ollama-docker-image/requirements.txt· python · 1 dependencies -
cookbook/livekit_agent_sdk/requirements.txt· python · 2 dependencies
Metadata
- Created: 2023-07-27
- First commit: 2023-07-27
- Last pushed: 2026-06-02
- Website: https://docs.litellm.ai/docs/
- Archived: no
- Stack detected: 2026-06-02 07:04
- License: NOASSERTION
AI development signals
AI agent config detected
5 config paths
5 files
0 directories
Agent instructions
Claude Code
3
Gemini CLI
Key config paths
-
file
AGENTS.md -
file
CLAUDE.md -
file
GEMINI.md -
file
litellm/proxy/_experimental/mcp_server/CLAUDE.md -
file
ui/litellm-dashboard/CLAUDE.md