Awesome Opensource Ai

The Open Source Feature Store for AI/ML

The Enterprise-Grade Production-Ready Multi-Agent Orchestration Framework. Website: https://swarms.ai

ClearML - Auto-Magical CI/CD to streamline your AI workload. Experiment Management, Data Management, Pipeline, Orchestration, Scheduling & Serving in one MLOps/LLMOps solution

Data processing for and with foundation models! 🍎 🍋 🌽 ➡️ ➡️🍸 🍹 🍷

NeMo Guardrails is an open-source toolkit for easily adding programmable guardrails to LLM-based conversational systems.

Open-source framework for building AI-powered apps in JavaScript, Go, and Python, built and used in production by Google

Aim 💫 — An easy-to-use & supercharged open-source experiment tracker.

结合知识库、知识图谱管理的 多租户 Agent Harness 平台。 An agent harness that integrates a LightRAG knowledge base and knowledge graphs. Build with LangChain + Vue + FastAPI, support DeepAgents、MinerU PDF、Neo4j 、MCP.

🧊 Open source LLM observability platform. One line of code to monitor, evaluate, and experiment. YC W23 🍓

An automated document analyzer for Paperless-ngx using OpenAI API, Ollama, Deepseek-r1, Azure and all OpenAI API compatible Services to automatically analyze and tag your documents.

Python SDK for AI agent monitoring, LLM cost tracking, benchmarking, and more. Integrates with most LLMs and agent frameworks including CrewAI, Agno, OpenAI Agents SDK, Langchain, Autogen, AG2, and CamelAI

Democratizing Reinforcement Learning for LLMs

Standardized Distributed Generative and Predictive AI Inference Platform for Scalable, Multi-Framework Deployment on Kubernetes

Optimize prompts, code, and more with AI-powered Reflective Text Evolution

A Low-Code MCP Framework for Building Complex and Innovative RAG Pipelines

⚡ Pure-Rust WebGPU inference engine — OpenAI-API compatible, GGUF native, runs on any GPU. No Python. No llama.cpp. Single binary.

⚡️next-generation personal AI assistant powered by LLM, RAG and agent loops, supporting computer-use, browser-use and coding agent, demo: https://demo.openagentai.org

A GPU cluster manager for high-performance AI model serving (vLLM, SGLang) and on-demand SSH-accessible GPU instances.

A Next-Generation Training Engine Built for Ultra-Large MoE Models

Argilla is a collaboration tool for AI engineers and domain experts to build high-quality datasets

Ecommerce Search and Discovery - marqo.ai

AI Agent Governance Toolkit — Policy enforcement, zero-trust identity, execution sandboxing, and reliability engineering for autonomous AI agents. Covers 10/10 OWASP Agentic Top 10.

A compact implementation of SGLang, designed to demystify the complexities of modern LLM serving systems.

Reliable Multi-Agent Orchestration Framework

A light-weight, flexible, and expressive statistical data testing library

One-for-All Multimodal Evaluation Toolkit Across Text, Image, Video, and Audio Tasks

The open-source LLMOps platform: prompt playground, prompt management, LLM evaluation, and LLM observability all in one place.

🦛 CHONK docs with Chonkie ✨ — The lightweight ingestion library for fast, efficient and robust RAG pipelines

AdalFlow: The library to build & auto-optimize LLM applications.

LightLLM is a Python-based LLM (Large Language Model) inference and serving framework, notable for its lightweight design, easy scalability, and high-speed performance.

A nearly-live implementation of OpenAI's Whisper.

An AI Gateway, registry, and proxy that sits in front of any MCP, A2A, or REST/gRPC APIs, exposing a unified endpoint with centralized discovery, guardrails and management. Optimizes Agent & Tool calling, and supports plugins.

OpenAgents - AI Agent Networks for Open Collaboration

A system for agentic LLM-powered data processing and ETL

VILA is a family of state-of-the-art vision language models (VLMs) for diverse multimodal AI tasks across the edge, data center, and cloud.

Generative models for conditional audio generation

Open-source security automation platform for teams and AI agents

A Comprehensive Benchmark to Evaluate LLMs as Agents (ICLR'24)

DeepResearchAgent is a hierarchical multi-agent system designed not only for deep research tasks but also for general-purpose task solving. The framework leverages a top-level planning agent to coordinate multiple specialized lower-level agents, enabling automated task decomposition and efficient execution across diverse and complex domains.

Evaluation and Tracking for LLM Experiments and AI Agents

MTEB: State-of-the-art evaluation of embeddings across languages and modalities

The Security Toolkit for LLM Interactions

RAG Web UI is an intelligent dialogue system based on RAG (Retrieval-Augmented Generation) technology.

PyTorch native quantization and sparsity for training and inference

Infinity is a high-throughput, low-latency serving engine for text-embeddings, reranking models, clip, clap and colpali

pingcap/autoflow is a Graph RAG based and conversational knowledge base tool built with TiDB Serverless Vector Storage. Demo: https://tidb.ai

Apache Hamilton helps data scientists and engineers define testable, modular, self-documenting dataflows, that encode lineage/tracing and metadata. Runs and scales everywhere python does.

Inspect: A framework for large language model evaluations

Python & JS/TS SDK for running AI-generated code/code interpreting in your AI app

Fully open data curation for reasoning models