github Actively maintained

kvcache-ai/Mooncake

Mooncake is the serving platform for Kimi, a leading LLM service provided by Moonshot AI.

2 awesome lists

Quick read

Stars
6,130
Forks
1,047
Open issues
459
Commits
1,723

Activity and growth

Latest capture 2026-08-03 03:06

Stars · last 7 days
No history
Commits · last 7 days
No history
Stars since tracking
+716
Stored snapshots
6

Classification

Metadata

Language
C++
License
Apache-2.0
Default branch
main
Created
2024-06-25
First commit
2024-06-25
Last pushed
2026-08-03
GitHub updated
2026-08-03
Last synced
2026-08-03 03:06
Stack scanned
2026-08-03 03:06
Archived
No

Growth history

Tracked growth

6 observed captures since 2026-05-25. Observed captures are shown by default.

Stars from first capture +716

Chart data

Observed captures only

Time horizon

All tracked data

Custom date range

Stars history

Observed snapshots

Commits history

Observed snapshots

Similar repositories

Nearest indexed repositories by embedding similarity.

LMCache/LMCache

LMCache: Supercharge Your LLM with the Fastest KV Cache Layer

10,988 stars
Python 2 awesome lists

llm-d/llm-d

Achieve state of the art inference performance with modern accelerators on Kubernetes

3,959 stars
Shell 2 awesome lists

vllm-project/vllm

A high-throughput and memory-efficient inference and serving engine for LLMs

90,045 stars
Python 4 awesome lists

xLLM-AI/xllm

A high-performance inference engine for LLM, VLM, DiT and REC models, optimized for diverse AI accelerators. It is hosted in OpenAtom Foundation.

1,555 stars
C++ 0 awesome lists

sgl-project/sglang

SGLang is a high-performance serving framework for large language models and multimodal models.

31,109 stars
Python 5 awesome lists

jd-opensource/xllm

A high-performance inference engine for LLM, VLM, DiT and REC models, optimized for diverse AI accelerators.

1,370 stars
C++ 1 awesome list