Awesome Opensource Ai

The AI that really does things. Any OS. Any Platform. The lobster way. 🦞

The context API to search, scrape, and interact with the web at scale. 🔥

The fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (or native) format with cost tracking, guardrails, load balancing, and logging [Bedrock, Azure, OpenAI, Anthropic, OpenAI, VertexAI, vLLM, Nvidia NIM]

aider is AI pair programming in your terminal

Orca is the ADE for working with a fleet of parallel agents. Run any coding agent with your own subscription. Available on desktop, mobile and VPS.

Apache Spark - A unified analytics engine for large-scale data processing

DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.

Universal LLM Deployment Engine with ML Compilation

Qwen3-Coder is the code version of Qwen3, the large language model series developed by Qwen team.

Unified framework for building enterprise RAG pipelines with small, specialized models

TensorZero is an open-source LLMOps platform that unifies an LLM gateway, observability, evaluation, optimization, and experimentation.

A vector search SQLite extension that runs anywhere!

An app that brings language models directly to your phone.

lakeFS - Data version control for your data lake | Git for data

One delightful Ruby framework for every major AI provider. Build AI agents, chatbots, RAG apps, and multimodal workflows in beautiful, expressive code.

An Open Standard for lineage metadata collection

Build LLM-powered applications in Ruby

Fast, Flexible and Portable Structured Generation

RTP-LLM: Alibaba's high-performance LLM inference engine for diverse applications.