Awesome Opensource Ai

The API to search, scrape, and interact with the web at scale. 🔥

Python SDK, Proxy Server (AI Gateway) to call 100+ LLM APIs in OpenAI (or native) format, with cost tracking, guardrails, loadbalancing and logging. [Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic, Sagemaker, HuggingFace, VLLM, NVIDIA NIM]

aider is AI pair programming in your terminal

Apache Spark - A unified analytics engine for large-scale data processing

DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.

Universal LLM Deployment Engine with ML Compilation

Qwen3-Coder is the code version of Qwen3, the large language model series developed by Qwen team.

Unified framework for building enterprise RAG pipelines with small, specialized models

TensorZero is an open-source LLMOps platform that unifies an LLM gateway, observability, evaluation, optimization, and experimentation.

A vector search SQLite extension that runs anywhere!

An app that brings language models directly to your phone.

lakeFS - Data version control for your data lake | Git for data

One delightful Ruby framework for every major AI provider. Build AI agents, chatbots, RAG apps, and multimodal workflows in beautiful, expressive code.

An Open Standard for lineage metadata collection

Build LLM-powered applications in Ruby

Fast, Flexible and Portable Structured Generation

RTP-LLM: Alibaba's high-performance LLM inference engine for diverse applications.