← Back to search
github Active AI dev

Repository profile

xorbitsai/inference

Swap GPT for any LLM by changing a single line of code. Xinference lets you run open-source, speech, and multimodal models on cloud, on-prem, or your laptop — all through one unified, production-ready inference API.

Python Apache-2.0 main Stack scanned README.md
Stars
9,398
Forks
842
Watchers
60
Issues
47
Commits
1,962
Awesome lists
3

Repository updates

Follow repository updates

Get generated xorbitsai/inference development summaries by email, or follow the weekly and monthly RSS feeds.

Sign in to subscribe by email. RSS feeds are public.

Sign in to subscribe

Activity and growth

Tracked growth, recent movement, and commit velocity from stored repository snapshots.

Latest capture 2026-07-01 03:09

Star growth, last 7 days
No 7-day history
Commit velocity, last 7 days
No 7-day history
Stars since baseline
+86
Snapshot coverage
4

Tracked growth

4 captures since 2026-05-26

Stars from baseline +86

Time horizon

All tracked data

Stars history

Total stars

Commits history

Default branch commits

Detected stack

Frameworks, package managers, ecosystems, and dependency manifests found during catalog scans.

Scanned 2026-07-01 03:09

Stack signals
7
Package managers
3
Manifest files
8
Dependencies
250

Frameworks and tools

  • FastAPI web framework · high confidence
  • Gradio app framework · high confidence
  • LangChain ai framework · high confidence
  • Next.js web framework · high confidence
  • pytest test framework · high confidence
  • React frontend framework · high confidence
  • Tailwind CSS css framework · high confidence
npm PEP 517 pip javascript python

Dependency files

8 manifests
  • pyproject.toml python ecosystem, 1 dependency
  • setup.cfg python ecosystem, 149 dependencies
  • setup.py python ecosystem, 0 dependencies
  • frontend/package.json javascript ecosystem, 57 dependencies
  • frontend/package-lock.json javascript ecosystem, 0 dependencies
  • xinference/ui/web/ui/package.json javascript ecosystem, 43 dependencies
  • xinference/ui/web/ui/package-lock.json javascript ecosystem, 0 dependencies
  • xinference/thirdparty/matcha/utils/monotonic_align/setup.py python ecosystem, 0 dependencies

Classification

Searchable topics, generated tags, and stack labels that explain where this repository fits.

Topics
20
Tags
0
Stacks
7

AI development signals

Agent instructions and tool configuration paths found in the repository tree.

2 paths

AI agent config detected

2 config paths 2 files 0 directories
Agent instructions Claude Code

Key config paths

Similar repositories

Nearest indexed repositories by embedding similarity.

xlang-ai/OpenAgents

[COLM 2024] OpenAgents: An Open Platform for Language Agents in the Wild

4,846 stars
Python 2 awesome lists

mudler/LocalAI

LocalAI is the open-source AI engine. Run any model - LLMs, vision, voice, image, video - on any hardware. No GPU required.

47,306 stars
Go 5 awesome lists

open-compass/opencompass

OpenCompass is an LLM evaluation platform, supporting a wide range of models (Llama3, Mistral, InternLM2,GPT-4,LLaMa2, Qwen,GLM, Claude, etc) over 100+ datasets.

7,191 stars
Python 3 awesome lists

eosphoros-ai/DB-GPT

open-source agentic AI data assistant for the next generation of AI + Data products.

19,498 stars
Python 3 awesome lists

ruc-datalab/DeepAnalyze

DeepAnalyze is the first agentic LLM for autonomous data science. 🎈你的AI数据分析师,自动分析大量数据,一键生成专业分析报告!

4,354 stars
Python 2 awesome lists

ludwig-ai/ludwig

Low-code framework for building custom LLMs, neural networks, and other AI models

11,737 stars
Python 2 awesome lists

Metadata

Language
Python
License
Apache-2.0
Default branch
main
Created
2023-06-14
First commit
2023-06-14
Last pushed
2026-07-01
GitHub updated
2026-07-01
Last synced
2026-07-01 03:09
Stack detected
2026-07-01 03:09
Archived
no
GitHub Website

https://inference.readthedocs.io

README

Appears in

3