Awesome Opensource Ai

A programming framework for agentic AI

[EMNLP2025] "LightRAG: Simple and Fast Retrieval-Augmented Generation"

In-depth tutorials on LLMs, RAGs and real-world AI agent applications.

Composio powers 1000+ toolkits, tool search, context management, authentication, and a sandboxed workbench to help you build AI agents that turn intent into action.

An open-source RAG-based tool for chatting with your documents.

Platform for stateful agents: AI with advanced memory that can learn and self-improve over time.

Debug, evaluate, and monitor your LLM applications, RAG systems, and agentic workflows with comprehensive tracing, automated evaluations, and production-ready dashboards.

The LLM Evaluation Framework

Supercharge Your LLM Application Evaluations 🚀

Build high-quality LLM apps - from prototyping, testing to production deployment and monitoring.

AI Observability & Evaluation

Evidently is ​​an open-source ML and LLM observability framework. Evaluate, test, and monitor any AI-powered system or data pipeline. From tabular data to Gen AI. 100+ metrics.

Adding guardrails to large language models.

结合知识库、知识图谱管理的 多租户 Agent Harness 平台。 An agent harness that integrates a LightRAG knowledge base and knowledge graphs. Build with LangChain + Vue + FastAPI, support DeepAgents、MinerU PDF、Neo4j 、MCP.

Python SDK for AI agent monitoring, LLM cost tracking, benchmarking, and more. Integrates with most LLMs and agent frameworks including CrewAI, Agno, OpenAI Agents SDK, Langchain, Autogen, AG2, and CamelAI

The open-source LLMOps platform: prompt playground, prompt management, LLM evaluation, and LLM observability all in one place.

Evaluation and Tracking for LLM Experiments and AI Agents

pingcap/autoflow is a Graph RAG based and conversational knowledge base tool built with TiDB Serverless Vector Storage. Demo: https://tidb.ai

🥤 RAGLite is a Python toolkit for Retrieval-Augmented Generation (RAG) with DuckDB or PostgreSQL

Readymade evaluators for your LLM apps

Weave is a toolkit for developing AI-powered applications, built by Weights & Biases.