EricLBuehler/candle-vllm
Efficent platform for inference and serving local LLMs including an OpenAI compatible API server.
Repository profile
Official inference framework for 1-bit LLMs
Repository updates
Get generated microsoft/BitNet development summaries by email, or follow the weekly and monthly RSS feeds.
Sign in to subscribe by email. RSS feeds are public.
Sign in to subscribeTracked growth, recent movement, and commit velocity from stored repository snapshots.
Latest capture 2026-07-15 03:14
5 captures since 2026-05-25
Stars from baseline +625
All tracked data
Frameworks, package managers, ecosystems, and dependency manifests found during catalog scans.
Scanned 2026-07-15 03:14
CMakeLists.txt
c-cpp ecosystem,
0 dependencies
requirements.txt
python ecosystem,
0 dependencies
gpu/requirements.txt
python ecosystem,
0 dependencies
src/CMakeLists.txt
c-cpp ecosystem,
0 dependencies
gpu/bitnet_kernels/setup.py
python ecosystem,
0 dependencies
Searchable topics, generated tags, and stack labels that explain where this repository fits.
Agent instructions and tool configuration paths found in the repository tree.
Nearest indexed repositories by embedding similarity.
Efficent platform for inference and serving local LLMs including an OpenAI compatible API server.
🏗️ Fine-tune, build, and deploy open-source LLMs easily!
A language for constraint-guided and efficient LLM programming.
Minimalist ML framework for Rust
llama.cpp fork with additional SOTA quants and improved performance
LLM inference in C/C++
403 Forbidden | https://api.github.com/repos/microsoft/BitNet/readme | message=API rate limit exceeded for user ID 260990068. If you reach out to GitHub Support for help, please include the request ID AC0E:CBDA0:D7FC90A:CCD2694:6A56FB21 and timestamp 2026-07-15 03:14:41 UTC. For more on scraping GitHub and how it may affect your rights, please review our Terms of Service (http | rate_limit_remaining=0 | rate_limit_reset=1784088007