Awesome Opensource Ai

A streamlined and customizable framework for efficient large model (LLM, VLM, AIGC) evaluation and performance benchmarking.

Visualize and compare datasets, target values and associations, with one line of code.

Fast, Accurate, Lightweight Python library to make State of the Art Embedding

Open-source deep-learning framework for building, training, and fine-tuning deep learning models using state-of-the-art Physics-ML methods

llama.cpp fork with additional SOTA quants and improved performance

RamaLama is an open-source developer tool that simplifies the local serving of AI models from any source and facilitates their use for inference in production, all through the familiar language of containers.

pingcap/autoflow is a Graph RAG based and conversational knowledge base tool built with TiDB Serverless Vector Storage. Demo: https://tidb.ai

Elegant easy-to-use neural networks + scientific computing in JAX. https://docs.kidger.site/equinox/

Infinity is a high-throughput, low-latency serving engine for text-embeddings, reranking models, clip, clap and colpali

Holistic Evaluation of Language Models (HELM) is an open source Python framework created by the Center for Research on Foundation Models (CRFM) at Stanford for holistic, reproducible and transparent evaluation of foundation models, including large language models (LLMs) and multimodal models.

PentestAgent is an AI agent framework for black-box security testing, supporting bug bounty, red-team, and penetration testing workflows.

A comprehensive set of fairness metrics for datasets and machine learning models, explanations for these metrics, and algorithms to mitigate bias in datasets and models.

A library for debugging/inspecting machine learning classifiers and explaining their predictions

Minimalistic large language model 3D-parallelism training

Probabilistic programming with NumPy powered by JAX for autograd and JIT compilation to GPU/TPU/CPU.

The code used to train and run inference with the ColVision models, e.g. ColPali, ColQwen2, and ColSmol.

DeepTeam is a framework to red team LLMs and AI agents.

An Open Standard for lineage metadata collection

Modular Python framework for AI agents and workflows with chain-of-thought reasoning, tools, and memory.

Apache Hamilton helps data scientists and engineers define testable, modular, self-documenting dataflows, that encode lineage/tracing and metadata. Runs and scales everywhere python does.

Inspect: A framework for large language model evaluations

Lighteval is your all-in-one toolkit for evaluating LLMs across multiple backends

Machine learning metrics for distributed, scalable PyTorch applications.

SDG is a specialized framework designed to generate high-quality structured tabular data.

Data Contracts engine for the modern data stack. https://www.soda.io

Python & JS/TS SDK for running AI-generated code/code interpreting in your AI app

Fully open data curation for reasoning models

Feature engineering and selection open-source Python library compatible with sklearn.

cuGraph - RAPIDS Graph Analytics Library

Vendor-agnostic orchestration for training, inference and agentic workloads across NVIDIA, AMD, TPU, and Tenstorrent on clouds, Kubernetes, and bare metal.

TFX is an end-to-end platform for deploying production ML pipelines

VeOmni: Scaling Any Modality Model Training with Model-Centric Distributed Recipe Zoo

Numerical differential equation solvers in JAX. Autodifferentiable and GPU-capable. https://docs.kidger.site/diffrax/

Enforce the output format (JSON Schema, Regex etc) of a language model

[ICLR & NeurIPS 2025] Repository for Show-o series, One Single Transformer to Unify Multimodal Understanding and Generation.

Free antidetect browser stealth for Playwright: undetected headless Firefox fingerprint. Python scraping, recaptcha and bot detection bypass. Open source

Agentic LLM Vulnerability Scanner / AI red teaming kit 🧪

:robot: MoveIt for ROS 2

Scalable toolkit for efficient model reinforcement

ContextGem: Effortless LLM extraction from documents

Exploratory analysis of Bayesian models with Python

Fast, Flexible and Portable Structured Generation

Developer Asset Hub for NVIDIA Nemotron — A one-stop resource for training recipes, usage cookbooks, datasets, and full end-to-end reference examples to build with Nemotron models

Agentic RL Training at Scale

Large-scale LLM inference engine

Reference implementations of MLPerf® training benchmarks

Synthetic data curation for post-training and structured data extraction

OpenMLDB is an open-source machine learning database that provides a feature platform computing consistent features for training and inference.

Automated Machine Learning on Kubernetes

Lightweight and extensible compatibility layer between dataframe libraries!