llm-d/llm-d
Achieve state of the art inference performance with modern accelerators on Kubernetes
Repository profile
SGLang is a high-performance serving framework for large language models and multimodal models.
Repository updates
Get generated sgl-project/sglang development summaries by email, or follow the weekly and monthly RSS feeds.
Sign in to subscribe by email. RSS feeds are public.
Sign in to subscribeTracked growth, recent movement, and commit velocity from stored repository snapshots.
Latest capture 2026-07-16 03:05
7 captures since 2026-05-22
Stars from baseline +2223
All tracked data
Frameworks, package managers, ecosystems, and dependency manifests found during catalog scans.
Scanned 2026-07-16 03:05
python/pyproject.toml
python ecosystem,
121 dependencies
python/setup.py
python ecosystem,
0 dependencies
sgl-kernel/CMakeLists.txt
c-cpp ecosystem,
4 dependencies
sgl-kernel/pyproject.toml
python ecosystem,
3 dependencies
sgl-model-gateway/Cargo.toml
rust ecosystem,
88 dependencies
experimental/sgl-router/Cargo.toml
rust ecosystem,
38 dependencies
rust/sglang-grpc/Cargo.toml
rust ecosystem,
12 dependencies
sgl-model-gateway/e2e_test/pyproject.toml
python ecosystem,
7 dependencies
Searchable topics, generated tags, and stack labels that explain where this repository fits.
Agent instructions and tool configuration paths found in the repository tree.
AI agent config detected
Key config paths
Showing the first 24 paths. 113 more detected.
Nearest indexed repositories by embedding similarity.
Achieve state of the art inference performance with modern accelerators on Kubernetes
A framework for few-shot evaluation of language models.
A compact implementation of SGLang, designed to demystify the complexities of modern LLM serving systems.
No description.
llama.cpp fork with additional SOTA quants and improved performance
slime is an LLM post-training framework for RL Scaling.