Awesome Opensource Ai

🧙 Build, run, and manage data pipelines for integrating and transforming data.

The easiest way to serve AI apps and models - Build Model Inference APIs, Job queues, LLM apps, Multi-model pipelines, and more!

Apache Beam is a unified programming model for Batch and Streaming data processing.

Out-of-Core hybrid Apache Arrow/NumPy DataFrame for Python, ML, visualization and exploration of big tabular data at a billion rows per second 🚀

Build effective agents using Model Context Protocol and simple workflow patterns

Stanford NLP Python library for tokenization, sentence segmentation, NER, and parsing of many human languages

Flexible and powerful framework for managing multiple AI agents and handling complex conversations

An open source python library for automated feature engineering

Open-source observability for your GenAI or LLM application, based on OpenTelemetry

The Open Source Feature Store for AI/ML

Dynamic, resilient AI orchestration. Coordinate data, models, and compute as you build AI workflows.

🧱 easy fast local-first microVM runtime and library

NeMo Guardrails is an open-source toolkit for easily adding programmable guardrails to LLM-based conversational systems.

the portable Python dataframe library

Julep — durable, composable AI agents. Flows that crash and resume, retry safely, and explain every step.

Aim 💫 — An easy-to-use & supercharged open-source experiment tracker.

Adversarial Robustness Toolbox (ART) - Python Library for Machine Learning Security - Evasion, Poisoning, Extraction, Inference - Red and Blue Teams

an ambient intelligence library

A system for quickly generating training data with weak supervision

A model-driven approach to building AI agents in just a few lines of code.

A GPU-accelerated library containing highly optimized building blocks and an execution engine for data processing to accelerate deep learning training and inference applications.

AI Agent Governance Toolkit — Policy enforcement, zero-trust identity, execution sandboxing, and reliability engineering for autonomous AI agents. Covers 10/10 OWASP Agentic Top 10.

OpenSpiel is a collection of environments and algorithms for research in general reinforcement learning and search/planning in games.

Astronomy and astrophysics core library

Free, ultrafast Copilot alternative for Vim and Neovim

AutoRAG: Now your agent can find anything in your computer. It gets smarter if you are using it frequently.

Time series forecasting with PyTorch

Lightning ⚡️ fast forecasting with statistical and econometric models.

High-level library to help with training and evaluating neural networks in PyTorch flexibly and transparently.

A fast library for AutoML and tuning. Join our Discord: https://discord.gg/Cppx2vSPVP.

AdalFlow: The library to build & auto-optimize LLM applications.

An AI Gateway, registry, and proxy that sits in front of any MCP, A2A, or REST/gRPC APIs, exposing a unified endpoint with centralized discovery, guardrails and management. Optimizes Agent & Tool calling, and supports plugins.

A system for agentic LLM-powered data processing and ETL

Deepchecks: Tests for Continuous Validation of ML Models & Data. Deepchecks is a holistic open-source solution for all of your AI & ML validation needs, enabling to thoroughly test your data and models from research to production.

Distilabel is a framework for synthetic data and AI feedback for engineers who need fast, reliable and scalable pipelines based on verified research papers.

Build production-ready AI agents in both Python and Typescript.

🕹️ Open-source, developer-first LLMOps platform designed to streamline prompt design, version management, instant delivery, collaboration, troubleshooting, observability and more.

🔅 Shapash: User-friendly Explainability and Interpretability to Develop Reliable and Transparent Machine Learning Models

Scalable and efficient data transformation framework - backwards compatible with dbt.

Visualize and compare datasets, target values and associations, with one line of code.

Open-source tools for prompt testing and experimentation, with support for both LLMs (e.g. OpenAI, LLaMA) and vector databases (e.g. Chroma, Weaviate, LanceDB).

Deepnote is a drop-in replacement for Jupyter with an AI-first design, sleek UI, new blocks, and native data integrations. Use Python, R, and SQL locally in your favorite IDE, then scale to Deepnote cloud for real-time collaboration, Deepnote agent, and deployable data apps. https://deepnote.com/

Data manipulation and transformation for audio signal processing, powered by PyTorch

A comprehensive set of fairness metrics for datasets and machine learning models, explanations for these metrics, and algorithms to mitigate bias in datasets and models.

A library for debugging/inspecting machine learning classifiers and explaining their predictions

Open source platform for AI Engineering: OpenTelemetry-native LLM Observability, GPU Monitoring, Guardrails, Evaluations, Prompt Management, Vault, Playground. 🚀💻 Integrates with 50+ LLM Providers, VectorDBs, Agent Frameworks and GPUs.

DeepTeam is a framework to red team LLMs and AI agents.

Modular Python framework for AI agents and workflows with chain-of-thought reasoning, tools, and memory.

Apache Hamilton helps data scientists and engineers define testable, modular, self-documenting dataflows, that encode lineage/tracing and metadata. Runs and scales everywhere python does.

Machine learning metrics for distributed, scalable PyTorch applications.