Sign in
← Back to search

jd-opensource/xllm

A high-performance inference engine for LLM, VLM, DiT and REC models, optimized for diverse AI accelerators.

#deepseek#glm#inference#inference-engine#large-language-models#llm-inference#qwen
Sign in to like jd-opensource/xllm Open website Open GitHub
Stars
1,300
Forks
209
Commits
940
Language
C++
Awesome lists
1

Similar repositories

vllm-project/vllm

A high-throughput and memory-efficient inference and serving engine for LLMs

81308 stars
Python 3 awesome lists

llm-d/llm-d

Achieve state of the art inference performance with modern accelerators on Kubernetes

3250 stars
Shell 1 awesome list

alibaba/rtp-llm

RTP-LLM: Alibaba's high-performance LLM inference engine for diverse applications.

1130 stars
Cuda 1 awesome list

LMCache/LMCache

Supercharge Your LLM with the Fastest KV Cache Layer

8344 stars
Python 1 awesome list

InternLM/lmdeploy

LMDeploy is a toolkit for compressing, deploying, and serving LLMs.

7873 stars
Python 2 awesome lists

Tracked growth

1 capture since 2026-05-25

Latest capture 2026-05-25 21:01

Stars history

Total stars

Commits history

Default branch commits

Metadata

AI development signals

AI agent config detected

34 config paths 22 files 12 directories
Agent instructions Agent workspace 27 Claude Code 3 Gemini CLI 3

Key config paths

  • dir .agents
  • dir .claude
  • dir .gemini
  • file AGENTS.md
  • file CLAUDE.md
Review config paths
  • Agent workspace .agents
  • Agent workspace .agents/skills
  • Agent workspace .agents/skills/add-unit-test
  • Agent workspace .agents/skills/add-unit-test/references
  • Agent workspace .agents/skills/add-unit-test/references/xllm-test-patterns.md
  • Agent workspace .agents/skills/add-unit-test/SKILL.md
  • Agent workspace .agents/skills/code-review
  • Agent workspace .agents/skills/code-review/references
  • Agent workspace .agents/skills/code-review/references/custom-code-style.md
  • Agent workspace .agents/skills/code-review/SKILL.md
  • Agent workspace .agents/skills/git-workflow
  • Agent workspace .agents/skills/git-workflow/references
  • Agent workspace .agents/skills/git-workflow/references/backport-flow.md
  • Agent workspace .agents/skills/git-workflow/references/branch-naming.md
  • Agent workspace .agents/skills/git-workflow/references/commit-format.md
  • Agent workspace .agents/skills/git-workflow/references/development-flow.md
  • Agent workspace .agents/skills/git-workflow/references/pr-review.md
  • Agent workspace .agents/skills/git-workflow/references/release-layout.md
  • Agent workspace .agents/skills/git-workflow/references/source-of-truth.md
  • Agent workspace .agents/skills/git-workflow/scripts
  • Agent workspace .agents/skills/git-workflow/scripts/collect_git_context.sh
  • Agent workspace .agents/skills/git-workflow/SKILL.md
  • Agent workspace .agents/skills/tilelang-api-best-practices
  • Agent workspace .agents/skills/tilelang-ascend-kernel

Showing the first 24 paths. 10 more detected.