Awesome Opensource Ai

Langflow is a powerful tool for building and deploying AI-powered agents and workflows.

The agent engineering platform.

Python ETL framework for stream processing, real-time analytics, LLM pipelines, and RAG.

Universal memory layer for AI Agents

Python SDK, Proxy Server (AI Gateway) to call 100+ LLM APIs in OpenAI (or native) format, with cost tracking, guardrails, loadbalancing and logging. [Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic, Sagemaker, HuggingFace, VLLM, NVIDIA NIM]

Making large AI models cheaper, faster and more accessible

In-depth tutorials on LLMs, RAGs and real-world AI agent applications.

The Frontend Stack for Agents & Generative UI. React, Angular, Mobile, Slack, and more. Makers of the AG-UI Protocol

An Open Source implementation of Notebook LM with more flexibility and features

Composio powers 1000+ toolkits, tool search, context management, authentication, and a sandboxed workbench to help you build AI agents that turn intent into action.

The batteries-included agent harness.

An open-source RAG-based tool for chatting with your documents.

"Vibe-Trading: Your Personal Trading Agent"

Platform for stateful agents: AI with advanced memory that can learn and self-improve over time.

🔥 MaxKB is an open-source platform for building enterprise-grade agents. 强大易用的开源企业级智能体平台。

FinGPT: Open-Source Financial Large Language Models! Revolutionize 🔥 We release the trained model on HuggingFace.

Debug, evaluate, and monitor your LLM applications, RAG systems, and agentic workflows with comprehensive tracing, automated evaluations, and production-ready dashboards.

Private AI platform for agents, assistants and enterprise search. Built-in Agent Builder, Deep research, Document analysis, Multi-model support, and API connectivity for agents.

A Flexible Framework for Experiencing Heterogeneous LLM Inference/Fine-tune Optimizations

The LLM Evaluation Framework

An orchestration platform for the development, production, and observation of data assets.

NotebookLM for Competitive Intelligence Research. Give your AI agents access to live data from Reddit, YouTube, Instagram, TikTok, Google Maps, Google Search, open web etc. Join our Discord: https://discord.gg/ejRNvftDp9

Supercharge Your LLM Application Evaluations 🚀

Retrieval and Retrieval-augmented LLMs

Build high-quality LLM apps - from prototyping, testing to production deployment and monitoring.

AI Observability & Evaluation

Swap GPT for any LLM by changing a single line of code. Xinference lets you run open-source, speech, and multimodal models on cloud, on-prem, or your laptop — all through one unified, production-ready inference API.

🧙 Build, run, and manage data pipelines for integrating and transforming data.

the LLM vulnerability scanner

FinRobot: An Open-Source AI Agent Platform for Financial Analysis using LLMs 🚀 🚀 🚀

NeMo Guardrails is an open-source toolkit for easily adding programmable guardrails to LLM-based conversational systems.

结合知识库、知识图谱管理的 多租户 Agent Harness 平台。 An agent harness that integrates a LightRAG knowledge base and knowledge graphs. Build with LangChain + Vue + FastAPI, support DeepAgents、MinerU PDF、Neo4j 、MCP.

Python SDK for AI agent monitoring, LLM cost tracking, benchmarking, and more. Integrates with most LLMs and agent frameworks including CrewAI, Agno, OpenAI Agents SDK, Langchain, Autogen, AG2, and CamelAI

Optimize prompts, code, and more with AI-powered Reflective Text Evolution

One-for-All Multimodal Evaluation Toolkit Across Text, Image, Video, and Audio Tasks

The open-source LLMOps platform: prompt playground, prompt management, LLM evaluation, and LLM observability all in one place.

OpenAgents - AI Agent Networks for Open Collaboration

DeepResearchAgent is a hierarchical multi-agent system designed not only for deep research tasks but also for general-purpose task solving. The framework leverages a top-level planning agent to coordinate multiple specialized lower-level agents, enabling automated task decomposition and efficient execution across diverse and complex domains.

Evaluation and Tracking for LLM Experiments and AI Agents

RAG Web UI is an intelligent dialogue system based on RAG (Retrieval-Augmented Generation) technology.

A framework for prompt tuning using Intent-based Prompt Calibration

Apache Hamilton helps data scientists and engineers define testable, modular, self-documenting dataflows, that encode lineage/tracing and metadata. Runs and scales everywhere python does.

An AI-powered agentic red team framework that automates offensive security operations, from reconnaissance to exploitation to post-exploitation, with zero human intervention.

Developer Asset Hub for NVIDIA Nemotron — A one-stop resource for training recipes, usage cookbooks, datasets, and full end-to-end reference examples to build with Nemotron models

Synthetic data curation for post-training and structured data extraction

A fast and lightweight framework for creating decentralized agents with ease.

Open-source, end-to-end platform for evaluating, observing, and improving LLM and AI agent applications. Tracing · Evals · Simulations · Datasets · Gateway · Guardrails. Self-hostable. Apache 2.0.

Readymade evaluators for your LLM apps