Awesome Opensource Ai

Get up and running with Kimi-K2.6, GLM-5.1, MiniMax, DeepSeek, gpt-oss, Qwen, Gemma and other models.

RAGFlow is a leading open-source Retrieval-Augmented Generation (RAG) engine that fuses cutting-edge RAG with Agent capabilities to create a superior context layer for LLMs

LocalAI is the open-source AI engine. Run any model - LLMs, vision, voice, image, video - on any hardware. No GPU required.

Milvus is a high-performance, cloud-native vector database built for scalable vector ANN search

DeepSeek-native AI coding agent for your terminal. Engineered around prefix-cache stability — leave it running.

Temporal service

Gas Town - multi-agent workspace manager

Workflow Engine for Kubernetes

Weaviate is an open-source vector database that stores both objects and vectors, allowing for the combination of vector search with structured filtering with the fault tolerance and scalability of a cloud-native database​.

The ultimate LLM/AI application development framework in Go.

Containers for machine learning

🤖 AI Gateway | AI Native API Gateway

Manage multiple AI terminal agents like Claude Code, Codex, OpenCode, and Amp.

Dynamic, resilient AI orchestration. Coordinate data, models, and compute as you build AI workflows.

Standardized Distributed Generative and Predictive AI Inference Platform for Scalable, Multi-Framework Deployment on Kubernetes

lakeFS - Data version control for your data lake | Git for data

⚡️next-generation personal AI assistant powered by LLM, RAG and agent loops, supporting computer-use, browser-use and coding agent, demo: https://demo.openagentai.org

Reliable model swapping for any local OpenAI/Anthropic compatible server - llama.cpp, vllm, etc

An MLOps framework to package, deploy, monitor and manage thousands of production machine learning models

Local-first session search, analytics, insights, and token use statistics for coding agents, supporting Claude Code, Codex, and more than 20 other agents.

Heterogeneous GPU Sharing on Kubernetes

Kubernetes-native Job Queueing

Manages Unified Access to Generative AI Services built on Envoy Gateway

KAI Scheduler is an open source Kubernetes Native scheduler for AI workloads at large scale

An open source DevOps tool from the CNCF for packaging and versioning AI/ML models, datasets, code, and configuration into an OCI Artifact.

Apache YuniKorn Core

Local-first TUI for AI coding-agent session history: trace cost, tokens, time, tool failures, latency, health, diffs, reports, and CI gates across local agent logs.