Awesome Opensource Ai

The easiest way to serve AI apps and models - Build Model Inference APIs, Job queues, LLM apps, Multi-model pipelines, and more!

PraisonAI 🦞 — Hire a 24/7 AI Workforce. Stop writing boilerplate and start shipping autonomous self-improving agents that research, plan, code, and execute tasks. Deployed in 5 lines of code with built-in memory, RAG, and support for 100+ LLMs.

Build effective agents using Model Context Protocol and simple workflow patterns

A vector search SQLite extension that runs anywhere!

Build autonomous AI agents in Python.

OpenShell is the safe, private runtime for autonomous AI agents.

Unified framework for robot learning built on NVIDIA Isaac Sim

Utilities intended for use with Llama models.

A Datacenter Scale Distributed Inference Serving Framework

Open-source observability for your GenAI or LLM application, based on OpenTelemetry

Flax is a neural network library for JAX that is designed for flexibility.

Tools for merging pretrained large language models.

The Open Source Feature Store for AI/ML

Dynamic, resilient AI orchestration. Coordinate data, models, and compute as you build AI workflows.

🧱 easy fast local-first microVM runtime and library

NeMo Guardrails is an open-source toolkit for easily adding programmable guardrails to LLM-based conversational systems.

Data processing for and with foundation models! 🍎 🍋 🌽 ➡️ ➡️🍸 🍹 🍷

Superagent protects your AI applications against prompt injections, data leaks, and harmful outputs. Embed safety directly into your app and prove compliance to your customers.

the portable Python dataframe library

Julep — durable, composable AI agents. Flows that crash and resume, retry safely, and explain every step.

可私有部署的多租户知识智能体平台：统一 RAG、知识图谱、多智能体、MCP/Skills、沙盒与权限管理。Self-hosted knowledge agent platform for RAG, knowledge graphs and multi-agent workflows.

Open-source framework for building AI-powered apps in JavaScript, Go, and Python, built and used in production by Google

A query and indexing engine for Redis, providing secondary indexing, full-text search, vector similarity search and aggregations.

The 100 line AI agent that solves GitHub issues or helps you in your command line. Radically simple, no huge configs, no giant monorepo—but scores >74% on SWE-bench verified!

an ambient intelligence library

Optimize prompts, code, and more with AI-powered Reflective Optimization

Open-source scientific and technical publishing system built on Pandoc.

Python SDK for AI agent monitoring, LLM cost tracking, benchmarking, and more. Integrates with most LLMs and agent frameworks including CrewAI, Agno, OpenAI Agents SDK, Langchain, Autogen, AG2, and CamelAI

Standardized Distributed Generative and Predictive AI Inference Platform for Scalable, Multi-Framework Deployment on Kubernetes

Local-first session search, analytics, insights, and token use statistics for coding agents, supporting Claude Code, Codex, and more than 20 other agents.

Democratizing Reinforcement Learning for LLMs

🐢 Open-Source Evaluation & Testing library for LLM Agents

A Low-Code MCP Framework for Building Complex and Innovative RAG Pipelines

AI Agent Governance Toolkit — Policy enforcement, zero-trust identity, execution sandboxing, and reliability engineering for autonomous AI agents. Covers 10/10 OWASP Agentic Top 10.

ZenML 🙏: One AI Platform from Pipelines to Agents. https://zenml.io.

A GPU cluster manager for high-performance AI model serving (vLLM, SGLang) and on-demand SSH-accessible GPU instances.

lakeFS - Data version control for your data lake | Git for data

Astronomy and astrophysics core library

Probabilistic time series modeling in Python

H2O LLM Studio - a framework and no-code GUI for fine-tuning LLMs. Documentation: https://docs.h2o.ai/h2o-llmstudio/

Ecommerce Search and Discovery - marqo.ai

A blazing fast inference solution for text embeddings models

AutoRAG: Now your agent can find anything in your computer. It gets smarter if you are using it frequently.

Lightning ⚡️ fast forecasting with statistical and econometric models.

Minimal CLI coding agent by Mistral

Relax! Flux is the ML library that doesn't make you tensor

Agenta is a workspace where you and your team build agents and automations.

The AI-native database built for LLM applications, providing incredibly fast hybrid search of dense vector, sparse vector, tensor (multi-vector), and full-text.

Reliable Multi-Agent Orchestration Framework

A light-weight, flexible, and expressive statistical data testing library