Sign in
← Back to search

EricLBuehler/candle-vllm

Efficent platform for inference and serving local LLMs including an OpenAI compatible API server.

Stars
667
Forks
81
Commits
Language
Rust
Awesome lists
1

Similar repositories

InternLM/HuixiangDou

HuixiangDou: Overcoming Group Chat Scenarios with LLM-based Technical Assistance

2490 stars
Python 1 awesome list

defog-ai/sql-eval

Evaluate the accuracy of LLM generated outputs

744 stars
Jupyter Notebook 0 awesome lists

microsoft/JARVIS

JARVIS, a system to connect LLMs with ML community. Paper: https://arxiv.org/pdf/2303.17580.pdf

24767 stars
Python 1 awesome list

FranxYao/chain-of-thought-hub

Benchmarking large language models' complex reasoning ability with chain-of-thought prompting

2774 stars
Jupyter Notebook 2 awesome lists

bobazooba/xllm

🦖 X—LLM: Cutting Edge & Easy LLM Finetuning

408 stars
Python 1 awesome list

Tracked growth

1 capture since 2026-05-27

Latest capture 2026-05-27 12:43

Stars history

Total stars

Commits history

Default branch commits

Metadata

  • Created: 2023-10-29
  • First commit: —
  • Last pushed: 2026-05-26
  • Archived: no
  • Stack detected: —
  • License: MIT

AI development signals

No AI development config files detected.