Awesome Opensource Ai

Lightweight coding agent that runs in your terminal

A high-throughput and memory-efficient inference and serving engine for LLMs

Code at the speed of thought – Zed is a high-performance, multiplayer code editor from the creators of Atom and Tree-sitter.

Open Data Platform for analysts, quants and AI agents.

Python ETL framework for stream processing, real-time analytics, LLM pipelines, and RAG.

The fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (or native) format with cost tracking, guardrails, load balancing, and logging [Bedrock, Azure, OpenAI, Anthropic, OpenAI, VertexAI, vLLM, Nvidia NIM]

an open source, extensible AI agent that goes beyond code suggestions - install, execute, edit, and test with any LLM

LocalAI is the open-source AI engine. Run any model - LLMs, vision, voice, image, video - on any hardware. No GPU required.

Milvus is a high-performance, cloud-native vector database built for scalable vector ANN search

Your Personal AI super intelligence. A brain that builds a local-first memory of your life, a fantastic orchestrator of agent fleets and workflows, and a deep researcher.

Compress tool outputs, logs, files, and RAG chunks before they reach the LLM. 60-95% fewer tokens, same answers. Library, proxy, MCP server.

Qdrant - High-performance, massive-scale Vector Database and Vector Search Engine for the next generation of AI. Also available in the cloud https://cloud.qdrant.io/

Self-hosted AI coding assistant

SGLang is a high-performance serving framework for large language models and multimodal models.

FastGPT is a knowledge-based platform built on the LLMs, offers a comprehensive suite of out-of-the-box capabilities such as data processing, RAG retrieval, and visual AI workflow orchestration, letting you easily develop and deploy complex question-answering systems without the need for extensive setup or configuration.

Search infrastructure for AI

A hive mind communication platform

A high-performance observability data pipeline.

Burn is a next generation tensor library and Deep Learning Framework that doesn't compromise on flexibility, efficiency and portability.

dbt enables data analysts and engineers to transform their data using the same practices that software engineers use to build applications.

TensorZero is an open-source LLMOps platform that unifies an LLM gateway, observability, evaluation, optimization, and experimentation.

Cloud-native OSS search engine for observability

Developer-friendly OSS embedded retrieval library for multimodal AI. Search More; Manage Less.

Instant, Concurrent, Secure & Lightweight Sandbox for AI Agents.

Containers for machine learning

⚙️🦀 Build modular and scalable LLM Applications in Rust

OpenShell is the safe, private runtime for autonomous AI agents.

A Datacenter Scale Distributed Inference Serving Framework

Fast, flexible LLM inference

🧱 easy fast local-first microVM runtime and library

⚡ Pure-Rust WebGPU inference engine — OpenAI-API compatible, GGUF native, runs on any GPU. No Python. No llama.cpp. Single binary.

HelixDB is an OLTP graph-vector database built in Rust on Object Storage.

A blazing fast inference solution for text embeddings models

Next Generation Agentic Proxy for AI Agents and MCP servers

An AI Gateway, registry, and proxy that sits in front of any MCP, A2A, or REST/gRPC APIs, exposing a unified endpoint with centralized discovery, guardrails and management. Optimizes Agent & Tool calling, and supports plugins.

AI Agent that handles engineering tasks end-to-end: integrates with developers’ tools, plans, executes, and iterates until it achieves a successful result.

Bionic is an on-premise replacement for ChatGPT, offering the advantages of Generative AI while maintaining strict data confidentiality

BitFun is a desktop-grade Agent runtimeand a ready-to-use suite of desktop Agent applications.with built-in Code Agent 、 Cowork Agent、Computer Use. It has memory, personality, and the ability to evolve over time