Awesome Opensource Ai

dbt enables data analysts and engineers to transform their data using the same practices that software engineers use to build applications.

Open-source search database for full-text, vector, and hybrid search with real-time indexing and SQL.

TensorZero is an open-source LLMOps platform that unifies an LLM gateway, observability, evaluation, optimization, and experimentation.

Cloud-native OSS search engine for observability

Developer-friendly OSS embedded retrieval library for multimodal AI. Search More; Manage Less.

💥 Fast State-of-the-Art Tokenizers optimized for Research and Production

LMCache: Supercharge Your LLM with the Fastest KV Cache Layer

All-in-one LLM CLI tool featuring Shell Assistant, Chat-REPL, RAG, AI Tools & Agents, with access to OpenAI, Claude, Gemini, Ollama, Groq, and more.

Instant, Concurrent, Secure & Lightweight Sandbox for AI Agents.

Multi-platform SDK for integrating GitHub Copilot Agent into apps and services

Cybersecurity AI (CAI), the framework for AI Security

Containers for machine learning

🚀 Next Gen Multi-tenant AI One-Stop Solution. Builtin Admin & Billing System. Enterprise-Grade Unified LLM Gateway Support for 200+ Models And 35+ Providers, Load Balacing w/ Priority-base Routing, Cost Management, Chat Share, Cloud Sync, Credit/Subscription Billing, All File Parsing, Web Search, Built-in Model Cache.

One Postgres for your application data, full-text search, vector retrieval, and aggregations. Home of the pg_search extension.

A fast, scalable, high performance Gradient Boosting on Decision Trees library, used for ranking, classification, regression and other machine learning tasks for Python, R, Java, C++. Supports computation on CPU and GPU.

🤖 AI Gateway | AI Native API Gateway

PraisonAI 🦞 — Hire a 24/7 AI Workforce. Stop writing boilerplate and start shipping autonomous self-improving agents that research, plan, code, and execute tasks. Deployed in 5 lines of code with built-in memory, RAG, and support for 100+ LLMs.

Coding Agent Harness

⚙️🦀 Build modular and scalable LLM Applications in Rust

A vector search SQLite extension that runs anywhere!

OpenShell is the safe, private runtime for autonomous AI agents.

A Datacenter Scale Distributed Inference Serving Framework

Fast, flexible LLM inference

Flax is a neural network library for JAX that is designed for flexibility.

Dynamic, resilient AI orchestration. Coordinate data, models, and compute as you build AI workflows.

A query and indexing engine for Redis, providing secondary indexing, full-text search, vector similarity search and aggregations.

LiteRT-LM is Google's production-ready, high-performance, open-source inference framework for deploying Large Language Models on edge devices.

Open-source scientific and technical publishing system built on Pandoc.

Mooncake is the serving platform for Kimi, a leading LLM service provided by Moonshot AI.

⚡ Pure-Rust WebGPU inference engine — OpenAI-API compatible, GGUF native, runs on any GPU. No Python. No llama.cpp. Single binary.

HelixDB is an OLTP graph-vector database built in Rust on Object Storage.

lakeFS - Data version control for your data lake | Git for data

OpenSpiel is a collection of environments and algorithms for research in general reinforcement learning and search/planning in games.

A blazing fast inference solution for text embeddings models

AI Agent Governance Toolkit — Policy enforcement, zero-trust identity, execution sandboxing, and reliability engineering for autonomous AI agents. Covers 10/10 OWASP Agentic Top 10.

An Engine-Agnostic Deep Learning Framework in Java

A Rust machine learning framework.

Latitude is the open-source ai monitoring platform.

Local-first session search, analytics, insights, and token use statistics for coding agents, supporting Claude Code, Codex, and more than 20 other agents.

Your agent in your terminal, equipped with local tools: writes code, uses the terminal, browses the web. Make your own persistent autonomous agent on top!

An AI Gateway, registry, and proxy that sits in front of any MCP, A2A, or REST/gRPC APIs, exposing a unified endpoint with centralized discovery, guardrails and management. Optimizes Agent & Tool calling, and supports plugins.

Next Generation Agentic Proxy for AI Agents and MCP servers

Simple, safe way to store and distribute tensors

Open-source multimodal retrieval engine (Morphik Core). By Morphik — AI back office for skilled nursing & senior living (morphik.ai).

AI Agent that handles engineering tasks end-to-end: integrates with developers’ tools, plans, executes, and iterates until it achieves a successful result.

Personal AI Notebooks. Organize files & webpages and generate notes from them. Open source, local & open data, open model choice (incl. local).

II-Agent: a new open-source framework to build and deploy intelligent agents

Freeing data processing from scripting madness by providing a set of platform-agnostic customizable pipeline processing blocks.

Postgres extension for vector search (DiskANN), complements pgvector for performance and scale. Postgres OSS licensed.

The pretty much "official" DSPy framework for Typescript