github Actively maintained

alibaba/rtp-llm

RTP-LLM: Alibaba's high-performance LLM inference engine for diverse applications.

1 awesome list

Quick read

Stars
1,292
Forks
249
Open issues
174
Commits
4,718

Activity and growth

Latest capture 2026-08-02 03:07

Stars · last 7 days
No history
Commits · last 7 days
No history
Stars since tracking
+162
Stored snapshots
6

Classification

Metadata

Language
Cuda
License
Apache-2.0
Default branch
main
Created
2023-12-27
First commit
2023-12-27
Last pushed
2026-08-02
GitHub updated
2026-07-31
Last synced
2026-08-02 03:07
Stack scanned
2026-08-02 03:07
Archived
No

AI development signals

2 paths

Agent instructions and tool configuration found in this repository.

Growth history

Tracked growth

6 observed captures since 2026-05-25. Observed captures are shown by default.

Stars from first capture +162

Chart data

Observed captures only

Time horizon

All tracked data

Custom date range

Stars history

Observed snapshots

Commits history

Observed snapshots

Similar repositories

Nearest indexed repositories by embedding similarity.

xLLM-AI/xllm

A high-performance inference engine for LLM, VLM, DiT and REC models, optimized for diverse AI accelerators. It is hosted in OpenAtom Foundation.

1,555 stars
C++ 0 awesome lists

jd-opensource/xllm

A high-performance inference engine for LLM, VLM, DiT and REC models, optimized for diverse AI accelerators.

1,370 stars
C++ 1 awesome list

vllm-project/vllm

A high-throughput and memory-efficient inference and serving engine for LLMs

90,045 stars
Python 4 awesome lists

OptimalScale/LMFlow

An Extensible Toolkit for Finetuning and Inference of Large Foundation Models. Large Models for All.

8,486 stars
Python 2 awesome lists

llm-d/llm-d

Achieve state of the art inference performance with modern accelerators on Kubernetes

3,959 stars
Shell 2 awesome lists

jianzhnie/LLamaTuner

Easy and Efficient Finetuning LLMs. (Supported LLama, LLama2, LLama3, Qwen, Baichuan, GLM , Falcon) 大模型高效量化训练+部署.

620 stars
Python 1 awesome list