Repository profile
A minimal Python framework for building custom AI inference servers with full control over logic, batching, and scaling.
Repository updates
Get generated Lightning-AI/LitServe development summaries by email, or follow the weekly and monthly RSS feeds.
Sign in to subscribe by email. RSS feeds are public.
Sign in to subscribeTracked growth, recent movement, and commit velocity from stored repository snapshots.
Latest capture 2026-07-15 03:14
5 captures since 2026-05-25
Stars from baseline +35
All tracked data
Frameworks, package managers, ecosystems, and dependency manifests found during catalog scans.
Scanned 2026-07-15 03:14
pyproject.toml
python ecosystem,
0 dependencies
Searchable topics, generated tags, and stack labels that explain where this repository fits.
Agent instructions and tool configuration paths found in the repository tree.
Nearest indexed repositories by embedding similarity.
Achieve state of the art inference performance with modern accelerators on Kubernetes
Open source platform for AI Engineering: OpenTelemetry-native LLM Observability, GPU Monitoring, Guardrails, Evaluations, Prompt Management, Vault, Playground. 🚀💻 Integrates with 50+ LLM Providers, VectorDBs, Agent Frameworks and GPUs.
A high-throughput and memory-efficient inference and serving engine for LLMs
Low-code framework for building custom LLMs, neural networks, and other AI models
Pretrain, finetune ANY AI model of ANY size on 1 or 10,000+ GPUs with zero code changes.
A powerful AI framework with structured Pydantic responses, flexible LLM integration, and advanced agent capabilities
https://lightning.ai/litserve?utm_source=litserve_readme&utm_medium=referral&utm_campaign=litserve_readme
README403 Forbidden | https://api.github.com/repos/Lightning-AI/LitServe/readme | message=API rate limit exceeded for user ID 260990068. If you reach out to GitHub Support for help, please include the request ID C1EA:48BB:D036A9B:C55E584:6A56FB07 and timestamp 2026-07-15 03:14:15 UTC. For more on scraping GitHub and how it may affect your rights, please review our Terms of Service (https | rate_limit_remaining=0 | rate_limit_reset=1784088007
