Awesome Opensource Ai

Data manipulation and transformation for audio signal processing, powered by PyTorch

PyTorch native quantization and sparsity for training and inference

Infinity is a high-throughput, low-latency serving engine for text-embeddings, reranking models, clip, clap and colpali

Holistic Evaluation of Language Models (HELM) is an open source Python framework created by the Center for Research on Foundation Models (CRFM) at Stanford for holistic, reproducible and transparent evaluation of foundation models, including large language models (LLMs) and multimodal models.

A training framework for Stable Baselines3 reinforcement learning agents, with hyperparameter optimization and pre-trained agents included.

A comprehensive set of fairness metrics for datasets and machine learning models, explanations for these metrics, and algorithms to mitigate bias in datasets and models.

PentestAgent is an AI agent framework for black-box security testing, supporting bug bounty, red-team, and penetration testing workflows.

Minimalistic large language model 3D-parallelism training

Probabilistic programming with NumPy powered by JAX for autograd and JIT compilation to GPU/TPU/CPU.

The code used to train and run inference with the ColVision models, e.g. ColPali, ColQwen2, and ColSmol.

[NeurIPS 2025] OmniSVG is the first family of end-to-end multimodal SVG generators that leverage pre-trained Vision-Language Models (VLMs), capable of generating complex and detailed SVGs, from simple icons to intricate anime characters.

Modular Python framework for AI agents and workflows with chain-of-thought reasoning, tools, and memory.

Build applications that make decisions (chatbots, agents, simulations, etc...). Monitor, trace, persist, and execute on your own infrastructure.

Lighteval is your all-in-one toolkit for evaluating LLMs across multiple backends

🤗 Evaluate: A library for easily evaluating machine learning models and datasets.

Machine learning metrics for distributed, scalable PyTorch applications.

SDG is a specialized framework designed to generate high-quality structured tabular data.

Data Contracts engine for the modern data stack. https://www.soda.io

Inspect: A framework for large language model evaluations

Python & JS/TS SDK for running AI-generated code/code interpreting in your AI app

Fully open data curation for reasoning models

A Python package to assess and improve fairness of machine learning models.

Feature engineering and selection open-source Python library compatible with sklearn.

An AI-powered agentic red team framework that automates offensive security operations, from reconnaissance to exploitation to post-exploitation, with zero human intervention.

TFX is an end-to-end platform for deploying production ML pipelines

Vendor-agnostic orchestration for training, inference and agentic workloads across NVIDIA, AMD, TPU, and Tenstorrent on clouds, Kubernetes, and bare metal.

VeOmni: Scaling Any Modality Model Training with Model-Centric Distributed Recipe Zoo

Numerical differential equation solvers in JAX. Autodifferentiable and GPU-capable. https://docs.kidger.site/diffrax/

Enforce the output format (JSON Schema, Regex etc) of a language model

DeepTeam is a framework to red team LLMs and AI agents.

Toward High-Accuracy Open-Source Biomolecular Structure Prediction.

Helios: Real Real-Time Long Video Generation Model

[ICLR & NeurIPS 2025] Repository for Show-o series, One Single Transformer to Unify Multimodal Understanding and Generation.

[CVPR 2025] Magma: A Foundation Model for Multimodal AI Agents

Agentic LLM Vulnerability Scanner / AI red teaming kit 🧪

ContextGem: Effortless LLM extraction from documents

Official, AWS-supported MCP servers, skills, and plugins to help AI agents build on AWS

Scalable toolkit for efficient model reinforcement

Interpretability and explainability of data and machine learning models

Reference implementations of MLPerf® training benchmarks

Anti-Detect Browser that passes every bot detection test. Drop-in Playwright replacement.

Synthetic data curation for post-training and structured data extraction

Automated Machine Learning on Kubernetes

MLRun is an open source MLOps platform for quickly building and managing continuous ML applications across their lifecycle. MLRun integrates into your development and CI/CD environment and automates the delivery of production data, ML pipelines, and online applications.

Lightweight and extensible compatibility layer between dataframe libraries!

Agentic RL Training at Scale

MMaDA - Open-Sourced Multimodal Large Diffusion Language Models (dLLMs with block diffusion, mixed-CoT, unified RL)

A fast and lightweight framework for creating decentralized agents with ease.

Machine learning with dataframes

MLE-bench is a benchmark for measuring how well AI agents perform at machine learning engineering