Sign in
← All awesome lists Search these repos

Awesome List

Awesome Llm

Awesome-LLM: a curated list of Large Language Model

Hannibal046/Awesome-LLM
Open GitHub
List stars
27,154
README repos
150
Indexed repos
63
List commits
-
Forks
2,640
Open issues
413

Tracked list growth

GitHub stars and default-branch commits for Hannibal046/Awesome-LLM.

Latest scan 2026-07-17 10:49

Likes history

GitHub stars

Commits history

Default branch commits

Indexed repositories

5 repos matching these filters.

Topic: llm-serving
Latest repo push 2026-07-17

Filter this list

Search within Awesome Llm or narrow by ecosystem and project health.

Clear 1 refinement
Search mode
Tune results
More filters Topics, generated tags, stack, files, age, archive status, and growth.
Ecosystem
Files

Choose a suggestion or use commas to require multiple files.

Health

Uses known first-commit dates.

Momentum
Filters by observed commit-count growth over the repository's latest 7-day capture window. Repositories without a recent baseline are excluded.
Filters by observed GitHub star growth over the repository's latest 7-day capture window. Repositories without a recent baseline are excluded.
Reset filters
Highlighted

Open highlighted repo slot

Put your repository first

Promote a GitHub repo at the top of Awesome repository list views for 7 days.

vllm-project/vllm

A high-throughput and memory-efficient inference and serving engine for LLMs

AI dev
Stack
Python Axum FastAPI pytest Starlette Cargo CMake PEP 517
GitHub topics
#amd #blackwell #cuda #deepseek #deepseek-v3 #gpt
Updated
2026-07-08
Lists
3 list mentions
First commit
2023-02-09
License
Apache-2.0
Issues
5,586 open
Sign in to like vllm-project/vllm
85,648
stars
Forks
19,091
Commits
18,535 commits
Star growth, last 7 days
No 7-day history
Commit velocity, last 7 days
No 7-day history
Website GitHub
NVIDIA/TensorRT-LLM

TensorRT LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and supports state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. TensorRT LLM also contains components to create Python and C++ runtimes that orchestrate the inference execution in a performant way.

AI dev
Stack
Python FastAPI Jupyter pytest Starlette CMake Conan PEP 517
GitHub topics
#blackwell #cuda #llm-serving #moe #pytorch
Updated
2026-07-15
Lists
2 list mentions
First commit
2023-09-20
License
NOASSERTION
Issues
1,507 open
Sign in to like NVIDIA/TensorRT-LLM
14,118
stars
Forks
2,561
Commits
7,877 commits
Star growth, last 7 days
0 0.0%
Commit velocity, last 7 days
0 0.0%
Website GitHub
skypilot-org/skypilot

Run, manage, and scale AI workloads on any AI infrastructure. Use one system to access & manage all AI compute (Kubernetes, Slurm, 20+ clouds, on-prem).

AI dev
Stack
Python Express FastAPI Next.js pytest Go modules npm PEP 517
GitHub topics
#cloud-computing #cloud-management #cost-optimization #deep-learning #distributed-training #gpu
Updated
2026-07-16
Lists
3 list mentions
First commit
2021-08-25
License
Apache-2.0
Issues
343 open
Sign in to like skypilot-org/skypilot
10,301
stars
Forks
1,135
Commits
5,461 commits
Star growth, last 7 days
0 0.0%
Commit velocity, last 7 days
0 0.0%
Website GitHub
gpustack/gpustack

A GPU cluster manager for high-performance AI model serving (vLLM, SGLang) and on-demand SSH-accessible GPU instances.

AI dev
Stack
Python FastAPI pytest pip uv
GitHub topics
#ascend #cuda #deepseek #distributed-inference #genai #high-performance-inference
Updated
2026-07-05
Lists
3 list mentions
First commit
2024-04-25
License
Apache-2.0
Issues
616 open
Sign in to like gpustack/gpustack
5,272
stars
Forks
561
Commits
3,226 commits
Star growth, last 7 days
No 7-day history
Commit velocity, last 7 days
No 7-day history
Website GitHub