Awesome Opensource Ai

The Context Platform for your Data and AI Stack

This project aim to reproduce Sora (Open AI T2V model), we wish the open source community contribute to this project.

Agent S: an open agentic framework that uses computers like a human

The most powerful local music generation model that outperforms almost all commercial alternatives, supporting Mac, AMD, Intel, and CUDA devices.

Graph-Native Infrastructure for Context and Accountable AI Systems

Build local voice agents with open-source models

Low-code framework for building custom LLMs, neural networks, and other AI models

Build high-quality LLM apps - from prototyping, testing to production deployment and monitoring.

Pocket Flow: 100-line LLM framework. Let Agents build Agents!

Kimi Code CLI is your next CLI agent.

LMCache: Supercharge Your LLM with the Fastest KV Cache Layer

AI Observability & Evaluation

Kedro is a toolbox for production-ready data science. It uses software engineering best practices to help you create data engineering and data science pipelines that are reproducible, maintainable, and modular.

The Triton Inference Server provides an optimized cloud and edge inferencing solution.

Python bindings for llama.cpp

The AI Compute Platform for frontier teams. SkyPilot turns fragmented AI compute into one AI supercomputer, so frontier AI teams build custom intelligence faster.

An Open-Source Asynchronous Coding Agent

Amphion (/æmˈfaɪən/) is a toolkit for Audio, Music, and Speech Generation. Its purpose is to support reproducible research and help junior researchers and engineers get started in the field of audio, music, and speech generation research and development.

Cybersecurity AI (CAI), the framework for AI Security

Swap GPT for any LLM by changing a single line of code. Xinference lets you run open-source, speech, and multimodal models on cloud, on-prem, or your laptop — all through one unified, production-ready inference API.

ModelScope: bring the notion of Model-as-a-Service to life.

The easiest way to serve AI apps and models - Build Model Inference APIs, Job queues, LLM apps, Multi-model pipelines, and more!

PraisonAI 🦞 — Hire a 24/7 AI Workforce. Stop writing boilerplate and start shipping autonomous self-improving agents that research, plan, code, and execute tasks. Deployed in 5 lines of code with built-in memory, RAG, and support for 100+ LLMs.

Build effective agents using Model Context Protocol and simple workflow patterns

LMDeploy is a toolkit for compressing, deploying, and serving LLMs.

A vector search SQLite extension that runs anywhere!

Build autonomous AI agents in Python.

FinRobot: An Open-Source AI Agent Platform for Financial Applications using Large Language Models

Flexible and powerful framework for managing multiple AI agents and handling complex conversations

A Datacenter Scale Distributed Inference Serving Framework

Ingest, parse, and optimize any data format ➡️ from documents to multimedia ➡️ for enhanced compatibility with GenAI frameworks

The Open Source Feature Store for AI/ML

The Enterprise-Grade Multi-Agent Orchestration Framework. Website: https://swarms.ai

NeMo Guardrails is an open-source toolkit for easily adding programmable guardrails to LLM-based conversational systems.

Data processing for and with foundation models! 🍎 🍋 🌽 ➡️ ➡️🍸 🍹 🍷

ClearML - Auto-Magical CI/CD to streamline your AI workload. Experiment Management, Data Management, Pipeline, Orchestration, Scheduling & Serving in one MLOps/LLMOps solution

Julep — durable, composable AI agents. Flows that crash and resume, retry safely, and explain every step.

可私有部署的多租户知识智能体平台：统一 RAG、知识图谱、多智能体、MCP/Skills、沙盒与权限管理。Self-hosted knowledge agent platform for RAG, knowledge graphs and multi-agent workflows.

Open-source framework for building AI-powered apps in JavaScript, Go, and Python, built and used in production by Google

Aim 💫 — An easy-to-use & supercharged open-source experiment tracker.

Upserts, Deletes And Incremental Processing on Big Data.

🧊 Open source LLM observability platform. One line of code to monitor, evaluate, and experiment. YC W23 🍓

Optimize prompts, code, and more with AI-powered Reflective Optimization

An automated document analyzer for Paperless-ngx using OpenAI API, Ollama, Deepseek-r1, Azure and all OpenAI API compatible Services to automatically analyze and tag your documents.

Python SDK for AI agent monitoring, LLM cost tracking, benchmarking, and more. Integrates with most LLMs and agent frameworks including CrewAI, Agno, OpenAI Agents SDK, Langchain, Autogen, AG2, and CamelAI

Standardized Distributed Generative and Predictive AI Inference Platform for Scalable, Multi-Framework Deployment on Kubernetes

Democratizing Reinforcement Learning for LLMs

⚡ Pure-Rust WebGPU inference engine — OpenAI-API compatible, GGUF native, runs on any GPU. No Python. No llama.cpp. Single binary.

A Low-Code MCP Framework for Building Complex and Innovative RAG Pipelines

⚡️next-generation personal AI assistant powered by LLM, RAG and agent loops, supporting computer-use, browser-use and coding agent, demo: https://demo.openagentai.org