Awesome Opensource Ai

MLE-bench is a benchmark for measuring how well AI agents perform at machine learning engineering

Machine learning with dataframes

A fast and lightweight framework for creating decentralized agents with ease.

A lightweight, low-dependency, unified API to use all common reranking and cross-encoder models.

Reference implementations of MLPerf® inference benchmarks

Fast Multimodal LLM on Mobile Devices

Code repo for "WebArena: A Realistic Web Environment for Building Autonomous Agents"

Open-source, end-to-end platform for evaluating, observing, and improving LLM and AI agent applications. Tracing · Evals · Simulations · Datasets · Gateway · Guardrails. Self-hostable. Apache 2.0.

The LLM Anti-Framework

Training Sparse Autoencoders on Language Models

The open document intelligence platform for builders and hackers - DMS for the agentic world

bloom - evaluate any behavior immediately  🌸🌱

Scalable and memory-optimized training of diffusion models

Ground truth layer for humans and AI agents working together. Version control for knowledge.

PinchBench is a benchmarking system for evaluating LLM models as OpenClaw coding agents. Made with 🦀 by the humans at https://kilo.ai

🌎💪 BrowserGym, a Gym environment for web task automation

Trained models & code to predict toxic comments on all 3 Jigsaw Toxic Comment Challenges. Built using ⚡ Pytorch Lightning and 🤗 Transformers. For access to our API, please email us at contact@unitary.ai.

Scalable machine 🤖 learning for time series forecasting.

XAI - An eXplainability toolbox for machine learning

🥤 RAGLite is a Python toolkit for Retrieval-Augmented Generation (RAG) with DuckDB or PostgreSQL

Lightning fast data version control system for large repositories of data. Feels like git, pushes and pulls like oxen.

NVTabular is a feature engineering and preprocessing library for tabular data designed to quickly and easily manipulate terabyte scale datasets used to train deep learning based recommender systems.

Readymade evaluators for your LLM apps

FAIR Sequence Modeling Toolkit 2

Weave is a toolkit for developing AI-powered applications, built by Weights & Biases.

Modular Reinforcement Learning (RL) library (implemented in PyTorch, JAX, and NVIDIA Warp) with support for Gymnasium/Gym, NVIDIA Isaac Lab, MuJoCo Playground and other environments

Ouroboros — self-creating AI agent. Born Feb 16, 2026.

Unified CLI for running AI coding agents in isolated containers. Includes built-in local metrics collection, HTTP traffic tracking, and an analytics dashboard to track agent actions.

Self-Programming AI Agent Framework. Agents create and refine their own workflows.