aniketmaurya/llm-inference
Large Language Model (LLM) Inference API and Chatbot
125 stars
Python
1 awesome list
BeastByteAI/scikit-llm
Seamlessly integrate LLMs into scikit-learn.
- Stars
- 3,498
- Forks
- 284
- Commits
- 182
- Language
- Python
- Awesome lists
- 2
Similar repositories
vllm-project/vllm
A high-throughput and memory-efficient inference and serving engine for LLMs
81308 stars
Python
3 awesome lists
Maximilian-Winter/llama-cpp-agent
The llama-cpp-agent framework is a tool designed for easy interaction with Large Language Models (LLMs). Allowing users to chat with LLM models, execute structured function calls and get structured output. Works also with models not fine-tuned to JSON output and function calls.
638 stars
Python
1 awesome list
kennethleungty/Llama-2-Open-Source-LLM-CPU-Inference
Running Llama 2 and other Open-Source LLMs on CPU Inference Locally for Document Q&A
974 stars
Python
1 awesome list
jianzhnie/LLamaTuner
Easy and Efficient Finetuning LLMs. (Supported LLama, LLama2, LLama3, Qwen, Baichuan, GLM , Falcon) 大模型高效量化训练+部署.
620 stars
Python
1 awesome list
jd-opensource/xllm
A high-performance inference engine for LLM, VLM, DiT and REC models, optimized for diverse AI accelerators.
1300 stars
C++
1 awesome list
Tracked growth
2 captures since 2026-05-27
Latest capture 2026-05-27 12:27
Stars history
Total starsCommits history
Default branch commitsMetadata
- Created: 2023-05-12
- First commit: 2023-05-12
- Last pushed: 2026-05-01
- Website: https://beastbyte.ai/
- Archived: no
- Stack detected: —
- License: MIT
AI development signals
No AI development config files detected.