Awesome Opensource Ai

A programming framework for agentic AI

[EMNLP2025] LightRAG: Simple and Fast Retrieval-Augmented Generation

DeepTutor: Lifelong Personalized Tutoring. https://deeptutor.info/.

In-depth tutorials on LLMs, RAGs and real-world AI agent applications.

Composio powers 1000+ toolkits, tool search, context management, authentication, and a sandboxed workbench to help you build AI agents that turn intent into action.

The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, and optimize production-quality AI applications while controlling costs and managing access to models and data.

An open-source RAG-based tool for chatting with your documents.

Debug, evaluate, and monitor your LLM applications, RAG systems, and agentic workflows with comprehensive tracing, automated evaluations, and production-ready dashboards.

The LLM Evaluation Framework

Supercharge Your LLM Application Evaluations 🚀

Build high-quality LLM apps - from prototyping, testing to production deployment and monitoring.

AI Observability & Evaluation

Evidently is ​​an open-source ML and LLM observability framework. Evaluate, test, and monitor any AI-powered system or data pipeline. From tabular data to Gen AI. 100+ metrics.

Open-source observability for your GenAI or LLM application, based on OpenTelemetry

Adding guardrails to large language models.

可私有部署的多租户知识智能体平台：统一 RAG、知识图谱、多智能体、MCP/Skills、沙盒与权限管理。Self-hosted knowledge agent platform for RAG, knowledge graphs and multi-agent workflows.

Python SDK for AI agent monitoring, LLM cost tracking, benchmarking, and more. Integrates with most LLMs and agent frameworks including CrewAI, Agno, OpenAI Agents SDK, Langchain, Autogen, AG2, and CamelAI

ZenML 🙏: One AI Platform from Pipelines to Agents. https://zenml.io.

AutoRAG: Now your agent can find anything in your computer. It gets smarter if you are using it frequently.

Agenta is a workspace where you and your team build agents and automations.

Evaluation and Tracking for LLM Experiments and AI Agents

pingcap/autoflow is a Graph RAG based and conversational knowledge base tool built with TiDB Serverless Vector Storage. Demo: https://tidb.ai

🥤 RAGLite is a Python toolkit for Retrieval-Augmented Generation (RAG) with DuckDB or PostgreSQL

Readymade evaluators for your LLM apps

Weave is a toolkit for developing AI-powered applications, built by Weights & Biases.