michaelfeil/infinity
Infinity is a high-throughput, low-latency serving engine for text-embeddings, reranking models, clip, clap and colpali
2808 stars
Python
2 awesome lists
huggingface/text-embeddings-inference
A blazing fast inference solution for text embeddings models
- Stars
- 4,820
- Forks
- 392
- Commits
- 354
- Language
- Rust
- Awesome lists
- 2
Similar repositories
devflowinc/trieve
All-in-one platform for search, recommendations, RAG, and analytics offered via API
2662 stars
Rust
1 awesome list
EleutherAI/lm-evaluation-harness
A framework for few-shot evaluation of language models.
12684 stars
Python
4 awesome lists
EleutherAI/gpt-neox
An implementation of model parallel autoregressive transformers on GPUs, based on the Megatron and DeepSpeed libraries
7432 stars
Python
3 awesome lists
modelscope/ms-swift
Use PEFT or Full-parameter to CPT/SFT/DPO/GRPO 600+ LLMs (Qwen3.6, DeepSeek-R1, GLM-5.1, InternLM3, Llama4, ...) and 300+ MLLMs (Qwen3-VL, Qwen3-Omni, InternVL3.5, Ovis2.5, GLM4.5v, Gemma4, Llava, Phi4, ...) (AAAI 2025).
14255 stars
Python
1 awesome list
ggml-org/llama.cpp
LLM inference in C/C++
113297 stars
C++
2 awesome lists
Tracked growth
1 capture since 2026-05-25
Latest capture 2026-05-25 21:00
Stars history
Total starsCommits history
Default branch commitsMetadata
- Created: 2023-10-13
- First commit: —
- Last pushed: 2026-04-30
- Website: https://huggingface.co/docs/text-embeddings-inference/quick_tour
- Archived: no
- Stack detected: —
- License: Apache-2.0
AI development signals
No AI development config files detected.