bentoml/BentoML
The easiest way to serve AI apps and models - Build Model Inference APIs, Job queues, LLM apps, Multi-model pipelines, and more!
8660 stars
Python
1 awesome list
bentoml/OpenLLM
Run any open-source LLMs, such as DeepSeek and Llama, as OpenAI compatible API endpoint in the cloud.
- Stars
- 12,335
- Forks
- 811
- Commits
- 1923
- Language
- Python
- Awesome lists
- 4
Similar repositories
getumbrel/llama-gpt
A self-hosted, offline, ChatGPT-like chatbot. Powered by Llama 2. 100% private, with no data leaving your device. New: Code Llama support!
10961 stars
TypeScript
3 awesome lists
ggml-org/llama.cpp
LLM inference in C/C++
113297 stars
C++
2 awesome lists
meta-llama/llama
Inference code for Llama models
59434 stars
Python
1 awesome list
UbiquitousLearning/mllm
Fast Multimodal LLM on Mobile Devices
1521 stars
C++
1 awesome list
mudler/LocalAI
LocalAI is the open-source AI engine. Run any model - LLMs, vision, voice, image, video - on any hardware. No GPU required.
46491 stars
Go
5 awesome lists
Tracked growth
3 captures since 2026-05-25
Latest capture 2026-05-27 12:28
Stars history
Total starsCommits history
Default branch commitsMetadata
- Created: 2023-04-19
- First commit: 2023-04-19
- Last pushed: 2026-05-25
- Website: https://bentoml.com
- Archived: no
- Stack detected: —
- License: Apache-2.0
AI development signals
No AI development config files detected.