Awesome Opensource Ai

Langflow is a powerful tool for building and deploying AI-powered agents and workflows.

The agent engineering platform.

21 Lessons, Get Started Building with Generative AI

🐙 Guides, papers, lessons, notebooks and resources for prompt engineering, context engineering, RAG, and AI Agents.

Build resilient agents.

Open-source AI orchestration framework for building context-engineered, production-ready LLM applications. Design modular pipelines and agent workflows with explicit control over retrieval, routing, memory, and generation. Built for scalable agents, RAG, multimodal applications, semantic search, and conversational systems.

The AI Toolkit for TypeScript. From the creators of Next.js, the AI SDK is a free open-source library for building AI-powered applications and agents

Agent2Agent (A2A) is an open protocol enabling communication and interoperability between opaque agentic applications.

A scalable generative AI framework built for researchers and developers working on Large Language Models, Multimodal, and Speech AI (Automatic Speech Recognition and Text-to-Speech)

Concurrently chat with ChatGPT, Bing Chat, Bard, Alpaca, Vicuna, Claude, ChatGLM, MOSS, 讯飞星火, 文心一言 and more, discover the best answers

Structured Outputs

A blazing fast AI Gateway with integrated guardrails. Route to 1,600+ LLMs, 50+ AI Guardrails with 1 fast & friendly API.

TensorZero is an open-source LLMOps platform that unifies an LLM gateway, observability, evaluation, optimization, and experimentation.

OpenVINO™ is an open source toolkit for optimizing and deploying AI inference

Streamlined interface for generating images with AI in Krita. Inpaint and outpaint with optional text prompt, no tweaking required.

Build, Manage and Deploy AI/ML Systems

Cybersecurity AI (CAI), the framework for AI Security

An AI-powered search engine with a generative UI

The easiest way to serve AI apps and models - Build Model Inference APIs, Job queues, LLM apps, Multi-model pipelines, and more!

⚙️🦀 Build modular and scalable LLM Applications in Rust

Evidently is ​​an open-source ML and LLM observability framework. Evaluate, test, and monitor any AI-powered system or data pipeline. From tabular data to Gen AI. 100+ metrics.

Flexible and powerful framework for managing multiple AI agents and handling complex conversations

Open-source observability for your GenAI or LLM application, based on OpenTelemetry

NeMo Guardrails is an open-source toolkit for easily adding programmable guardrails to LLM-based conversational systems.

The CLI and skills that turn any coding assistant into an expert at creating, evaluating, and deploying AI agents on Google Cloud.

H2O LLM Studio - a framework and no-code GUI for fine-tuning LLMs. Documentation: https://docs.h2o.ai/h2o-llmstudio/

AdalFlow: The library to build & auto-optimize LLM applications.

The Python Risk Identification Tool for generative AI (PyRIT) is an open source framework built to empower security professionals and engineers to proactively identify risks in generative AI systems.

An AI Gateway, registry, and proxy that sits in front of any MCP, A2A, or REST/gRPC APIs, exposing a unified endpoint with centralized discovery, guardrails and management. Optimizes Agent & Tool calling, and supports plugins.

Superfast AI decision making and intelligent processing of multi-modal data.

Synthetic data generation for tabular data

Build applications that make decisions (chatbots, agents, simulations, etc...). Monitor, trace, persist, and execute on your own infrastructure.

SDG is a specialized framework designed to generate high-quality structured tabular data.

ContextGem: Effortless LLM extraction from documents

The good ol' Forge WebUI, now updated with new features~