Awesome Opensource Ai

Get up and running with Kimi-K2.6, GLM-5.2, MiniMax, DeepSeek, gpt-oss, Qwen, Gemma and other models.

🪨 why use many token when few token do trick — Claude Code skill that cuts 65% of tokens by talking like caveman

RAGFlow is a leading open-source Retrieval-Augmented Generation (RAG) engine that fuses cutting-edge RAG with Agent capabilities to create a superior context layer for LLMs

LocalAI is the open-source AI engine. Run any model - LLMs, vision, voice, image, video - on any hardware. No GPU required.

Milvus is a high-performance, cloud-native vector database built for scalable vector ANN search

DeepSeek-native AI coding agent for your terminal. Engineered around prefix-cache stability — leave it running.

Temporal service

Fast, efficient, battle-tested at Alibaba's scale. Hybrid architecture code review tool: deterministic pipelines + LLM Agent, precise line-level comments, built-in multi-language ruleset (NPE, thread-safety, XSS, SQL injection), OpenAI & Anthropic compatible.

Gas Town - multi-agent workspace manager

Workflow Engine for Kubernetes

Weaviate is an open-source vector database that stores both objects and vectors, allowing for the combination of vector search with structured filtering with the fault tolerance and scalability of a cloud-native database​.

The ultimate LLM/AI application development framework in Go.

Containers for machine learning

🤖 AI Gateway | AI Native API Gateway

Manage multiple AI terminal agents like Claude Code, Codex, OpenCode, and Amp.

Dynamic, resilient AI orchestration. Coordinate data, models, and compute as you build AI workflows.

Standardized Distributed Generative and Predictive AI Inference Platform for Scalable, Multi-Framework Deployment on Kubernetes

Local-first session search, analytics, insights, and token use statistics for coding agents, supporting Claude Code, Codex, and more than 20 other agents.

⚡️next-generation personal AI assistant powered by LLM, RAG and agent loops, supporting computer-use, browser-use and coding agent, demo: https://demo.openagentai.org

lakeFS - Data version control for your data lake | Git for data

Reliable model swapping for any local OpenAI/Anthropic compatible server - llama.cpp, vllm, etc

An MLOps framework to package, deploy, monitor and manage thousands of production machine learning models

Heterogeneous GPU Sharing on Kubernetes

Kubernetes-native Job Queueing

Manages Unified Access to Generative AI Services built on Envoy Gateway

KAI Scheduler is an open source Kubernetes Native scheduler for AI workloads at large scale

An open source DevOps tool from the CNCF for packaging and versioning AI/ML models, datasets, code, and configuration into an OCI Artifact.

Apache YuniKorn Core

Terminal-native chat client for OpenClaw, Hermes, Ollama and OpenAI-compatible providers. A pure, beautiful terminal chat experience - connect to the gateway, pick an agent, and chat with streaming responses. No fuss, just chat.