Awesome Opensource Ai

Dynamic, resilient AI orchestration. Coordinate data, models, and compute as you build AI workflows.

🧱 easy fast local-first microVM runtime and library

Open-source framework for building AI-powered apps in JavaScript, Go, and Python, built and used in production by Google

Mooncake is the serving platform for Kimi, a leading LLM service provided by Moonshot AI.

Standardized Distributed Generative and Predictive AI Inference Platform for Scalable, Multi-Framework Deployment on Kubernetes

Local-first session search, analytics, insights, and token use statistics for coding agents, supporting Claude Code, Codex, and more than 20 other agents.

HelixDB is an OLTP graph-vector database built in Rust on Object Storage.

⚡️next-generation personal AI assistant powered by LLM, RAG and agent loops, supporting computer-use, browser-use and coding agent, demo: https://demo.openagentai.org

AI Agent Governance Toolkit — Policy enforcement, zero-trust identity, execution sandboxing, and reliability engineering for autonomous AI agents. Covers 10/10 OWASP Agentic Top 10.

lakeFS - Data version control for your data lake | Git for data

The CLI and skills that turn any coding assistant into an expert at creating, evaluating, and deploying AI agents on Google Cloud.

Reliable model swapping for any local OpenAI/Anthropic compatible server - llama.cpp, vllm, etc

An MLOps framework to package, deploy, monitor and manage thousands of production machine learning models

The AI-native database built for LLM applications, providing incredibly fast hybrid search of dense vector, sparse vector, tensor (multi-vector), and full-text.

A full-stack AI Red Teaming platform securing AI ecosystems via OpenClaw Security Scan, Agent Scan, Skills Scan, MCP scan, AI Infra scan and LLM jailbreak evaluation.

Next Generation Agentic Proxy for AI Agents and MCP servers

An AI Gateway, registry, and proxy that sits in front of any MCP, A2A, or REST/gRPC APIs, exposing a unified endpoint with centralized discovery, guardrails and management. Optimizes Agent & Tool calling, and supports plugins.

Machine Learning Pipelines for Kubeflow

Heterogeneous GPU Sharing on Kubernetes

Fully customizable AI chatbot component for your website

The pretty much "official" DSPy framework for Typescript

Kubernetes-native Job Queueing

Open source platform for AI Engineering: OpenTelemetry-native LLM Observability, GPU Monitoring, Guardrails, Evaluations, Prompt Management, Vault, Playground. 🚀💻 Integrates with 50+ LLM Providers, VectorDBs, Agent Frameworks and GPUs.

An Open Standard for lineage metadata collection

Vendor-agnostic orchestration for training, inference and agentic workloads across NVIDIA, AMD, TPU, and Tenstorrent on clouds, Kubernetes, and bare metal.

Manages Unified Access to Generative AI Services built on Envoy Gateway

OpenMLDB is an open-source machine learning database that provides a feature platform computing consistent features for training and inference.

Automated Machine Learning on Kubernetes

MLRun is an open source MLOps platform for quickly building and managing continuous ML applications across their lifecycle. MLRun integrates into your development and CI/CD environment and automates the delivery of production data, ML pipelines, and online applications.

Fast Multimodal LLM on Mobile Devices

Open-source, end-to-end platform for evaluating, observing, and improving LLM and AI agent applications. Tracing · Evals · Simulations · Datasets · Gateway · Guardrails. Self-hostable. Apache 2.0.

Tools for building GPU clusters

KAI Scheduler is an open source Kubernetes Native scheduler for AI workloads at large scale

An open source DevOps tool from the CNCF for packaging and versioning AI/ML models, datasets, code, and configuration into an OCI Artifact.

Apache YuniKorn Core

World's first fully integrated and fully Automated Kubernetes management and orchestration solution

Terminal-native chat client for OpenClaw, Hermes, Ollama and OpenAI-compatible providers. A pure, beautiful terminal chat experience - connect to the gateway, pick an agent, and chat with streaming responses. No fuss, just chat.