llm-d/llm-d
Achieve state of the art inference performance with modern accelerators on Kubernetes
3250 stars
Shell
1 awesome list
Lightning-AI/LitServe
A minimal Python framework for building custom AI inference servers with full control over logic, batching, and scaling.
- Stars
- 3,883
- Forks
- 285
- Commits
- 759
- Language
- Python
- Awesome lists
- 1
Similar repositories
vllm-project/vllm
A high-throughput and memory-efficient inference and serving engine for LLMs
81308 stars
Python
3 awesome lists
ludwig-ai/ludwig
Low-code framework for building custom LLMs, neural networks, and other AI models
11705 stars
Python
2 awesome lists
openlit/openlit
Open source platform for AI Engineering: OpenTelemetry-native LLM Observability, GPU Monitoring, Guardrails, Evaluations, Prompt Management, Vault, Playground. 🚀💻 Integrates with 50+ LLM Providers, VectorDBs, Agent Frameworks and GPUs.
2487 stars
TypeScript
2 awesome lists
Lightning-AI/pytorch-lightning
Pretrain, finetune ANY AI model of ANY size on 1 or 10,000+ GPUs with zero code changes.
31156 stars
Python
3 awesome lists
markolofsen/litellm2
A powerful AI framework with structured Pydantic responses, flexible LLM integration, and advanced agent capabilities
3 stars
Jupyter Notebook
0 awesome lists
Tracked growth
1 capture since 2026-05-25
Latest capture 2026-05-25 21:04
Stars history
Total starsCommits history
Default branch commitsMetadata
- Created: 2023-12-12
- First commit: —
- Last pushed: 2026-05-04
- Website: https://lightning.ai/litserve?utm_source=litserve_readme&utm_medium=referral&utm_campaign=litserve_readme
- Archived: no
- Stack detected: —
- License: Apache-2.0
AI development signals
No AI development config files detected.