Sign in
← Back to search
github Actively maintained

jundot/omlx

LLM inference server with continuous batching & SSD caching for Apple Silicon — managed from the macOS menu bar

2 awesome lists

Quick read

Stars
21,455
Forks
1,830
Open issues
1,305
Commits
2,549

Activity and growth

Latest capture 2026-09-06 10:54

Stars · last 7 days
No history
Commits · last 7 days
No history
Stars since tracking
0
Stored snapshots
1

Classification

Topics

#apple-silicon #inference-server #llm #macos #mlx #openai-api

Technology stack

FastAPI pytest

Metadata

Language
Python
License
Apache-2.0
Default branch
main
Created
2026-02-13
First commit
2026-02-13
Last pushed
2026-09-06
GitHub updated
2026-09-06
Last synced
2026-09-06 10:54
Stack scanned
2026-09-06 10:54
Archived
No
Sign in to like jundot/omlx
README Open website View on GitHub

AI development signals

0 paths

Agent instructions and tool configuration found in this repository.

No config files detected.

Growth history

Tracked growth

1 observed capture since 2026-09-06. Observed captures are shown by default.

Stars from first capture 0

Chart data

Observed captures only

Time horizon

All tracked data

Custom date range

Stars history

Observed snapshots

Commits history

Observed snapshots

Similar repositories

Nearest indexed repositories by embedding similarity.

lemonade-sdk/lemonade

Lemonade helps users discover and run local AI apps by serving optimized LLMs right from their own GPUs and NPUs. Join our discord: https://discord.gg/5xXzkMu8Zk

5,632 stars
C++ 1 awesome list

ml-explore/mlx

MLX: An array framework for Apple silicon

28,379 stars
C++ 2 awesome lists

ikawrakow/ik_llama.cpp

llama.cpp fork with additional SOTA quants and improved performance

3,203 stars
C++ 1 awesome list

ollama/ollama

Get up and running with Kimi-K2.6, GLM-5.2, MiniMax, DeepSeek, gpt-oss, Qwen, Gemma and other models.

178,491 stars
Go 9 awesome lists

mudler/LocalAI

LocalAI is the open-source AI engine. Run any model - LLMs, vision, voice, image, video - on any hardware. No GPU required.

48,515 stars
Go 6 awesome lists