Sign in
← All awesome lists Search these repos

Awesome List

Awesome Chatgpt

A curated list of awesome LLM frameworks, libraries and software.

uhub/awesome-llm #ai #awesome #awesome-list #curated-list #large-language-models #list #llm #resources
Open GitHub
List stars
824
README repos
1,000
Indexed repos
1,135
List commits
617
Forks
88
Open issues
16

Tracked list growth

GitHub stars and default-branch commits for uhub/awesome-llm.

Latest scan 2026-09-03 10:49

Likes history

GitHub stars

Commits history

Default branch commits

Indexed repositories

10 repos matching these filters.

Topic: inference
Latest repo push 2026-09-04

Filter this list

Search within Awesome Chatgpt or narrow by ecosystem and project health.

Clear 1 refinement
Search mode
Tune results
More filters Topics, generated tags, stack, files, age, archive status, and growth.
Ecosystem
Files

Choose a suggestion or use commas to require multiple files.

Health

Uses known first-commit dates.

Momentum
Filters by observed commit-count growth over the repository's latest 7-day capture window. Repositories without a recent baseline are excluded.
Filters by observed GitHub star growth over the repository's latest 7-day capture window. Repositories without a recent baseline are excluded.
Reset filters
Highlighted

Open highlighted repo slot

Put your repository first

Promote a GitHub repo at the top of Awesome repository list views for 7 days.

vllm-project/vllm

A high-throughput and memory-efficient inference and serving engine for LLMs

AI dev
Stack
Python Axum FastAPI pytest Starlette Cargo CMake PEP 517
GitHub topics
#amd #blackwell #cuda #deepseek #deepseek-v3 #gpt
Updated
2026-08-26
Lists
4 list mentions
First commit
2023-02-09
License
Apache-2.0
Issues
7,012 open
Sign in to like vllm-project/vllm
90,045
stars
Forks
21,204
Commits
20,408 commits
Star growth, last 7 days
No 7-day history
Commit velocity, last 7 days
No 7-day history
Website GitHub
sgl-project/sglang

SGLang is a high-performance serving framework for large language models and multimodal models.

AI dev
Stack
Python Axum FastAPI gRPC Go pytest Cargo CMake Go modules
GitHub topics
#attention #blackwell #cuda #deepseek #diffusion #glm
Updated
2026-08-03
Lists
5 list mentions
First commit
2023-10-09
License
Apache-2.0
Issues
4,914 open
Sign in to like sgl-project/sglang
31,109
stars
Forks
7,596
Commits
15,967 commits
Star growth, last 7 days
No 7-day history
Commit velocity, last 7 days
No 7-day history
Website GitHub
xorbitsai/inference

Swap GPT for any LLM by changing a single line of code. Xinference lets you run open-source, speech, and multimodal models on cloud, on-prem, or your laptop — all through one unified, production-ready inference API.

AI dev
Stack
Python FastAPI LangChain Next.js pytest npm PEP 517 pip
GitHub topics
#artificial-intelligence #chatglm #deployment #flan-t5 #gemma #ggml
Updated
2026-08-12
Lists
4 list mentions
First commit
2023-06-14
License
Apache-2.0
Issues
53 open
Sign in to like xorbitsai/inference
9,491
stars
Forks
853
Commits
2,112 commits
Star growth, last 7 days
No 7-day history
Commit velocity, last 7 days
No 7-day history
Website GitHub
kvcache-ai/Mooncake

Mooncake is the serving platform for Kimi, a leading LLM service provided by Moonshot AI.

AI dev
Stack
C++ Gin gRPC Go Cargo CMake Go modules
GitHub topics
#disaggregation #inference #kvcache #llm #rdma #reinforcement-learning
Updated
2026-08-03
Lists
2 list mentions
First commit
2024-06-25
License
Apache-2.0
Issues
459 open
Sign in to like kvcache-ai/Mooncake
6,130
stars
Forks
1,047
Commits
1,723 commits
Star growth, last 7 days
No 7-day history
Commit velocity, last 7 days
No 7-day history
Website GitHub
gpustack/gpustack

A GPU cluster manager for high-performance AI model serving (vLLM, SGLang) and on-demand SSH-accessible GPU instances.

AI dev
Stack
Python FastAPI pytest uv
GitHub topics
#ascend #cuda #deepseek #distributed-inference #genai #high-performance-inference
Updated
2026-08-20
Lists
4 list mentions
First commit
2024-04-25
License
Apache-2.0
Issues
684 open
Sign in to like gpustack/gpustack
5,524
stars
Forks
622
Commits
3,440 commits
Star growth, last 7 days
No 7-day history
Commit velocity, last 7 days
No 7-day history
Website GitHub