Awesome Opensource Ai

Scale computer-use 2.0 with open-source drivers, cross-OS fleets, and benchmarks for training, evaluation, and data generation.

Minimalist ML framework for Rust

The most RAM efficient harness

GenBI (Generative BI) for AI agents, an open-source, governed text-to-SQL through an open context layer that turns natural-language questions into trusted dashboards, charts, and SQL across 20+ data sources, such as BigQuery, Snowflake, PostgreSQL, ClickHouse, Amazon Redshift, Databricks and more.

"DeepCode: Open Agentic Coding (Paper2Code & Text2Web & Text2Backend)"

Simple, unified interface to multiple Generative AI providers

MNN: A blazing-fast, lightweight inference engine battle-tested by Alibaba, powering high-performance on-device LLMs and Edge AI.

Burn is a next generation tensor library and Deep Learning Framework that doesn't compromise on flexibility, efficiency and portability.

Tantivy is a full-text search engine library inspired by Apache Lucene and written in Rust

dbt enables data analysts and engineers to transform their data using the same practices that software engineers use to build applications.

Open-source search database for full-text, vector, and hybrid search with real-time indexing and SQL.

TensorZero is an open-source LLMOps platform that unifies an LLM gateway, observability, evaluation, optimization, and experimentation.

Cloud-native OSS search engine for observability

Developer-friendly OSS embedded retrieval library for multimodal AI. Search More; Manage Less.

LMCache: Supercharge Your LLM with the Fastest KV Cache Layer

💥 Fast State-of-the-Art Tokenizers optimized for Research and Production

Instant, Concurrent, Secure & Lightweight Sandbox for AI Agents.

Multi-platform SDK for integrating GitHub Copilot Agent into apps and services

All-in-one LLM CLI tool featuring Shell Assistant, Chat-REPL, RAG, AI Tools & Agents, with access to OpenAI, Claude, Gemini, Ollama, Groq, and more.

Cybersecurity AI (CAI), the framework for AI Security

Containers for machine learning

🚀 Next Gen Multi-tenant AI One-Stop Solution. Builtin Admin & Billing System. Enterprise-Grade Unified LLM Gateway Support for 200+ Models And 35+ Providers, Load Balacing w/ Priority-base Routing, Cost Management, Chat Share, Cloud Sync, Credit/Subscription Billing, All File Parsing, Web Search, Built-in Model Cache.

One Postgres for your application data, full-text search, vector retrieval, and aggregations. Home of the pg_search extension.

A fast, scalable, high performance Gradient Boosting on Decision Trees library, used for ranking, classification, regression and other machine learning tasks for Python, R, Java, C++. Supports computation on CPU and GPU.

🤖 AI Gateway | AI Native API Gateway

PraisonAI 🦞 — Hire a 24/7 AI Workforce. Stop writing boilerplate and start shipping autonomous self-improving agents that research, plan, code, and execute tasks. Deployed in 5 lines of code with built-in memory, RAG, and support for 100+ LLMs.

⚙️🦀 Build modular and scalable LLM Applications in Rust

A vector search SQLite extension that runs anywhere!

OpenShell is the safe, private runtime for autonomous AI agents.

A Datacenter Scale Distributed Inference Serving Framework

Fast, flexible LLM inference

Flax is a neural network library for JAX that is designed for flexibility.

Dynamic, resilient AI orchestration. Coordinate data, models, and compute as you build AI workflows.

🧱 easy fast local-first microVM runtime and library

A query and indexing engine for Redis, providing secondary indexing, full-text search, vector similarity search and aggregations.

Mooncake is the serving platform for Kimi, a leading LLM service provided by Moonshot AI.

LiteRT-LM is Google's production-ready, high-performance, open-source inference framework for deploying Large Language Models on edge devices.

Open-source scientific and technical publishing system built on Pandoc.

Local-first session search, analytics, insights, and token use statistics for coding agents, supporting Claude Code, Codex, and more than 20 other agents.

⚡ Pure-Rust WebGPU inference engine — OpenAI-API compatible, GGUF native, runs on any GPU. No Python. No llama.cpp. Single binary.

HelixDB is an OLTP graph-vector database built in Rust on Object Storage.

AI Agent Governance Toolkit — Policy enforcement, zero-trust identity, execution sandboxing, and reliability engineering for autonomous AI agents. Covers 10/10 OWASP Agentic Top 10.

lakeFS - Data version control for your data lake | Git for data

OpenSpiel is a collection of environments and algorithms for research in general reinforcement learning and search/planning in games.

A blazing fast inference solution for text embeddings models

An Engine-Agnostic Deep Learning Framework in Java

A Rust machine learning framework.

Latitude is the open-source AI monitoring platform.

Your agent in your terminal, equipped with local tools: writes code, uses the terminal, browses the web. Make your own persistent autonomous agent on top!

Next Generation Agentic Proxy for AI Agents and MCP servers