bentoml/OpenLLM
Run any open-source LLMs, such as DeepSeek and Llama, as OpenAI compatible API endpoint in the cloud.
12335 stars
Python
4 awesome lists
eth-sri/lmql
A language for constraint-guided and efficient LLM programming.
- Stars
- 4,184
- Forks
- 222
- Commits
- 1002
- Language
- Python
- Awesome lists
- 2
Similar repositories
UbiquitousLearning/mllm
Fast Multimodal LLM on Mobile Devices
1521 stars
C++
1 awesome list
EleutherAI/lm-evaluation-harness
A framework for few-shot evaluation of language models.
12684 stars
Python
4 awesome lists
mosaicml/llm-foundry
LLM training code for Databricks foundation models
4408 stars
Python
1 awesome list
InternLM/lmdeploy
LMDeploy is a toolkit for compressing, deploying, and serving LLMs.
7873 stars
Python
2 awesome lists
kennethleungty/Llama-2-Open-Source-LLM-CPU-Inference
Running Llama 2 and other Open-Source LLMs on CPU Inference Locally for Document Q&A
974 stars
Python
1 awesome list
Tracked growth
2 captures since 2026-05-27
Latest capture 2026-05-27 12:44
Stars history
Total starsCommits history
Default branch commitsMetadata
- Created: 2022-11-24
- First commit: 2022-11-24
- Last pushed: 2025-05-22
- Website: https://lmql.ai
- Archived: no
- Stack detected: —
- License: Apache-2.0
AI development signals
No AI development config files detected.