learn LLM inference system on Apple Silicon for systems engineers: build a tiny vLLM + Qwen
Appears on
Quick read
Latest capture 2026-09-10 10:54
1 path
Agent instructions and tool configuration found in this repository.
Agent instructions
1 observed capture since 2026-09-10. Observed captures are shown by default.
Stars from first capture 0
Observed captures only
All tracked data
Observed snapshots
Observed snapshots
Nearest indexed repositories by embedding similarity.
Course to get into Large Language Models (LLMs) with roadmaps and Colab notebooks.
LLM training in simple, raw C/CUDA
🤖 𝗟𝗲𝗮𝗿𝗻 for 𝗳𝗿𝗲𝗲 how to 𝗯𝘂𝗶𝗹𝗱 an end-to-end 𝗽𝗿𝗼𝗱𝘂𝗰𝘁𝗶𝗼𝗻-𝗿𝗲𝗮𝗱𝘆 𝗟𝗟𝗠 & 𝗥𝗔𝗚 𝘀𝘆𝘀𝘁𝗲𝗺 using 𝗟𝗟𝗠𝗢𝗽𝘀 best practices: ~ 𝘴𝘰𝘶𝘳𝘤𝘦 𝘤𝘰𝘥𝘦 + 12 𝘩𝘢𝘯𝘥𝘴-𝘰𝘯 𝘭𝘦𝘴𝘴𝘰𝘯𝘴
A high-throughput and memory-efficient inference and serving engine for LLMs
llama.cpp fork with additional SOTA quants and improved performance
LLM inference server with continuous batching & SSD caching for Apple Silicon — managed from the macOS menu bar
