Awesome Opensource Ai

A unified library of SOTA model optimization techniques like quantization, distillation, pruning, neural architecture search, speculative decoding, etc. It compresses deep learning models for downstream deployment frameworks like TensorRT-LLM, TensorRT, vLLM, etc. to optimize inference speed.

Distilabel is a framework for synthetic data and AI feedback for engineers who need fast, reliable and scalable pipelines based on verified research papers.

Build production-ready AI agents in both Python and Typescript.

JAX-based neural network library

Freeing data processing from scripting madness by providing a set of platform-agnostic customizable pipeline processing blocks.

Dead simple FLUX LoRA training UI with LOW VRAM support

Scalable and efficient data transformation framework - backwards compatible with dbt.

The Security Toolkit for LLM Interactions

A streamlined and customizable framework for efficient large model (LLM, VLM, AIGC) evaluation and performance benchmarking.

Skywork-R1V is an advanced multimodal AI model series developed by Skywork AI, specializing in vision-language reasoning.

OneTrainer is a one-stop solution for all your Diffusion training needs.

Visualize and compare datasets, target values and associations, with one line of code.

Fast, Accurate, Lightweight Python library to make State of the Art Embedding

Open-source deep-learning framework for building, training, and fine-tuning deep learning models using state-of-the-art Physics-ML methods

Open-source tools for prompt testing and experimentation, with support for both LLMs (e.g. OpenAI, LLaMA) and vector databases (e.g. Chroma, Weaviate, LanceDB).

A framework for prompt tuning using Intent-based Prompt Calibration

RamaLama is an open-source developer tool that simplifies the local serving of AI models from any source and facilitates their use for inference in production, all through the familiar language of containers.

PyTorch native quantization for training and inference

Elegant easy-to-use neural networks + scientific computing in JAX. https://docs.kidger.site/equinox/

Data manipulation and transformation for audio signal processing, powered by PyTorch

Infinity is a high-throughput, low-latency serving engine for text-embeddings, reranking models, clip, clap and colpali

Holistic Evaluation of Language Models (HELM) is an open source Python framework created by the Center for Research on Foundation Models (CRFM) at Stanford for holistic, reproducible and transparent evaluation of foundation models, including large language models (LLMs) and multimodal models.

PentestAgent is an AI agent framework for black-box security testing, supporting bug bounty, red-team, and penetration testing workflows.

A training framework for Stable Baselines3 reinforcement learning agents, with hyperparameter optimization and pre-trained agents included.

A comprehensive set of fairness metrics for datasets and machine learning models, explanations for these metrics, and algorithms to mitigate bias in datasets and models.

Minimalistic large language model 3D-parallelism training

Probabilistic programming with NumPy powered by JAX for autograd and JIT compilation to GPU/TPU/CPU.

The code used to train and run inference with the ColVision models, e.g. ColPali, ColQwen2, and ColSmol.

DeepTeam is a framework to red team LLMs and AI agents.

[NeurIPS 2025] OmniSVG is the first family of end-to-end multimodal SVG generators that leverage pre-trained Vision-Language Models (VLMs), capable of generating complex and detailed SVGs, from simple icons to intricate anime characters.

Modular Python framework for AI agents and workflows with chain-of-thought reasoning, tools, and memory.

Official, AWS-supported MCP servers, skills, and plugins to help AI agents build on AWS

Inspect: A framework for large language model evaluations

Lighteval is your all-in-one toolkit for evaluating LLMs across multiple backends

Build applications that make decisions (chatbots, agents, simulations, etc...). Monitor, trace, persist, and execute on your own infrastructure.

🤗 Evaluate: A library for easily evaluating machine learning models and datasets.

Machine learning metrics for distributed, scalable PyTorch applications.

SDG is a specialized framework designed to generate high-quality structured tabular data.

Data Contracts engine for the modern data stack. https://www.soda.io

Python & JS/TS SDK for running AI-generated code/code interpreting in your AI app

Fully open data curation for reasoning models

A Python package to assess and improve fairness of machine learning models.

Feature engineering and selection open-source Python library compatible with sklearn.

An AI-powered agentic red team framework that automates offensive security operations, from reconnaissance to exploitation to post-exploitation, with zero human intervention.

Vendor-agnostic orchestration for training, inference and agentic workloads across NVIDIA, AMD, TPU, and Tenstorrent on clouds, Kubernetes, and bare metal.

TFX is an end-to-end platform for deploying production ML pipelines

VeOmni: Scaling Any Modality Model Training with Model-Centric Distributed Recipe Zoo

Numerical differential equation solvers in JAX. Autodifferentiable and GPU-capable. https://docs.kidger.site/diffrax/

Enforce the output format (JSON Schema, Regex etc) of a language model

Helios: Real Real-Time Long Video Generation Model