Awesome Opensource Ai

🤗 Evaluate: A library for easily evaluating machine learning models and datasets.

Machine learning metrics for distributed, scalable PyTorch applications.

Lighteval is your all-in-one toolkit for evaluating LLMs across multiple backends

PentestAgent is an AI agent framework for black-box security testing, supporting bug bounty, red-team, and penetration testing workflows.

SDG is a specialized framework designed to generate high-quality structured tabular data.

Data Contracts engine for the modern data stack. https://www.soda.io

Bionic is an on-premise replacement for ChatGPT, offering the advantages of Generative AI while maintaining strict data confidentiality

Python & JS/TS SDK for running AI-generated code/code interpreting in your AI app

Fully open data curation for reasoning models

Feature engineering and selection open-source Python library compatible with sklearn.

A Python package to assess and improve fairness of machine learning models.

Collect, aggregate, and visualize a data ecosystem's metadata

TFX is an end-to-end platform for deploying production ML pipelines

cuGraph - RAPIDS Graph Analytics Library

Research project. A Memory solution for users, teams, and applications.

Inspect: A framework for large language model evaluations

Vendor-agnostic orchestration for training, inference and agentic workloads across NVIDIA, AMD, TPU, and Tenstorrent on clouds, Kubernetes, and bare metal.

Harbor is a framework for running agent evaluations and creating and using RL environments.

Fractal Graph-of-Thought. Rhizomatic Mind-Mapping for Ai-Agents, Web-Links, Notes, and Code.

Vim plugin for LLM-assisted code/text completion

Build applications that make decisions (chatbots, agents, simulations, etc...). Monitor, trace, persist, and execute on your own infrastructure.

Enforce the output format (JSON Schema, Regex etc) of a language model

Numerical differential equation solvers in JAX. Autodifferentiable and GPU-capable. https://docs.kidger.site/diffrax/

Production-grade 3D gaussian splatting with CPU/GPU support for Windows, Mac and Linux 🚀

Moonshot's most powerful model

Build LLM-powered applications in Ruby

VeOmni: Scaling Any Modality Model Training with Model-Centric Distributed Recipe Zoo

A beautiful local-first coding agent running in your terminal - built by the community for the community ⚒

The PHP Agentic Framework to build production-ready AI driven applications. Connect components (LLMs, vector DBs, memory) to agents that can interact with your data.

[ICLR & NeurIPS 2025] Repository for Show-o series, One Single Transformer to Unify Multimodal Understanding and Generation.

[CVPR 2025] Magma: A Foundation Model for Multimodal AI Agents

Toward High-Accuracy Open-Source Biomolecular Structure Prediction.

A Julia machine learning framework

An AI-powered agentic red team framework that automates offensive security operations, from reconnaissance to exploitation to post-exploitation, with zero human intervention.

The leading open-source AI copilot for JetBrains. Connect to any model in any environment, and customize your coding experience in any way you like.

Agentic LLM Vulnerability Scanner / AI red teaming kit 🧪

Helios: Real Real-Time Long Video Generation Model

ContextGem: Effortless LLM extraction from documents

Exploratory analysis of Bayesian models with Python

:robot: MoveIt for ROS 2

DeepTeam is a framework to red team LLMs and LLM systems.

A vector indexing library to bring fast, fresh and filtered search to your database

Practical course about Large Language Models.

Dive is an open-source MCP Host Desktop Application that seamlessly integrates with any LLMs supporting function calling capabilities. ✨

Responsible AI Toolbox is a suite of tools providing model and data exploration and assessment user interfaces and libraries that enable a better understanding of AI systems. These interfaces and libraries empower developers and stakeholders of AI systems to develop and monitor AI more responsibly, and take better data-driven actions.

Interpretability and explainability of data and machine learning models

Reference implementations of MLPerf® training benchmarks

Large-scale LLM inference engine

🤖 Autonomous agent framework for Elixir. Built for distributed, autonomous behavior and dynamic workflows.

JVector: the most advanced embedded vector search engine