bentoml/OpenLLM
Run any open-source LLMs, such as DeepSeek and Llama, as OpenAI compatible API endpoint in the cloud.
12335 stars
Python
4 awesome lists
bentoml/BentoML
The easiest way to serve AI apps and models - Build Model Inference APIs, Job queues, LLM apps, Multi-model pipelines, and more!
- Stars
- 8,654
- Forks
- 968
- Commits
- 3754
- Language
- Python
- Awesome lists
- 1
Similar repositories
axolotl-ai-cloud/axolotl
Go ahead and axolotl questions
11960 stars
Python
2 awesome lists
clearml/clearml
ClearML - Auto-Magical CI/CD to streamline your AI workload. Experiment Management, Data Management, Pipeline, Orchestration, Scheduling & Serving in one MLOps/LLMOps solution
6708 stars
Python
2 awesome lists
ludwig-ai/ludwig
Low-code framework for building custom LLMs, neural networks, and other AI models
11705 stars
Python
2 awesome lists
neuml/txtai
💡 All-in-one AI framework for semantic search, LLM orchestration and language model workflows
12607 stars
Python
2 awesome lists
Lightning-AI/LitServe
A minimal Python framework for building custom AI inference servers with full control over logic, batching, and scaling.
3883 stars
Python
1 awesome list
Tracked growth
1 capture since 2026-05-25
Latest capture 2026-05-25 20:52
Stars history
Total starsCommits history
Default branch commitsMetadata
- Created: 2019-04-02
- First commit: —
- Last pushed: 2026-05-07
- Website: https://bentoml.com
- Archived: no
- Stack detected: —
- License: Apache-2.0
AI development signals
No AI development config files detected.