LightLLM is a Python-based LLM (Large Language Model) inference and serving framework, notable for its lightweight design, easy scalability, and high-speed performance.
Appears on
Quick read
Latest capture 2026-08-03 03:09
0 paths
Agent instructions and tool configuration found in this repository.
No config files detected.
6 observed captures since 2026-05-25. Observed captures are shown by default.
Stars from first capture +126
Observed captures only
All tracked data
Observed snapshots
Observed snapshots
Nearest indexed repositories by embedding similarity.
A high-performance inference engine for LLM, VLM, DiT and REC models, optimized for diverse AI accelerators. It is hosted in OpenAtom Foundation.
A high-throughput and memory-efficient inference and serving engine for LLMs
Democratizing Reinforcement Learning for LLMs
A high-performance inference engine for LLM, VLM, DiT and REC models, optimized for diverse AI accelerators.
An Extensible Toolkit for Finetuning and Inference of Large Foundation Models. Large Models for All.
Universal LLM Deployment Engine with ML Compilation
