Awesome Opensource Ai

A full-stack AI Red Teaming platform securing AI ecosystems via OpenClaw Security Scan, Agent Scan, Skills Scan, MCP scan, AI Infra scan and LLM jailbreak evaluation.

One-for-All Multimodal Evaluation Toolkit Across Text, Image, Video, and Audio Tasks

The Python Risk Identification Tool for generative AI (PyRIT) is an open source framework built to empower security professionals and engineers to proactively identify risks in generative AI systems.

🦛 CHONK docs with Chonkie ✨ — The lightweight ingestion library for fast, efficient and robust RAG pipelines

Next Generation Agentic Proxy for AI Agents and MCP servers

An AI Gateway, registry, and proxy that sits in front of any MCP, A2A, or REST/gRPC APIs, exposing a unified endpoint with centralized discovery, guardrails and management. Optimizes Agent & Tool calling, and supports plugins.

TorchGeo: datasets, samplers, transforms, and pre-trained models for geospatial data

Harness LLMs with Multi-Agent Programming

A system for agentic LLM-powered data processing and ETL

A minimal Python framework for building custom AI inference servers with full control over logic, batching, and scaling.

Simple, safe way to store and distribute tensors

Generative models for conditional audio generation

Framework for evaluating and improving agents

Superfast AI decision making and intelligent processing of multi-modal data.

Open-source security automation platform for teams and AI agents

A library for mechanistic interpretability of GPT-style language models

The best OSS video generation models, created by Genmo

Open-source multimodal retrieval engine (Morphik Core). By Morphik — AI back office for skilled nursing & senior living (morphik.ai).

Quickly and accurately render even the largest data.

Evaluation and Tracking for LLM Experiments and AI Agents

MTEB: State-of-the-art evaluation of embeddings across languages and modalities

II-Agent: a new open-source framework to build and deploy intelligent agents

A unified library of SOTA model optimization techniques like quantization, distillation, pruning, neural architecture search, speculative decoding, etc. It compresses deep learning models for downstream deployment frameworks like TensorRT-LLM, TensorRT, vLLM, etc. to optimize inference speed.

Freeing data processing from scripting madness by providing a set of platform-agnostic customizable pipeline processing blocks.

Open-source deep-learning framework for building, training, and fine-tuning deep learning models using state-of-the-art Physics-ML methods

A framework for prompt tuning using Intent-based Prompt Calibration

RamaLama is an open-source developer tool that simplifies the local serving of AI models from any source and facilitates their use for inference in production, all through the familiar language of containers.

pingcap/autoflow is a Graph RAG based and conversational knowledge base tool built with TiDB Serverless Vector Storage. Demo: https://tidb.ai

Elegant easy-to-use neural networks + scientific computing in JAX. https://docs.kidger.site/equinox/

Holistic Evaluation of Language Models (HELM) is an open source Python framework created by the Center for Research on Foundation Models (CRFM) at Stanford for holistic, reproducible and transparent evaluation of foundation models, including large language models (LLMs) and multimodal models.

Probabilistic programming with NumPy powered by JAX for autograd and JIT compilation to GPU/TPU/CPU.

An Open Standard for lineage metadata collection

Modular Python framework for AI agents and workflows with chain-of-thought reasoning, tools, and memory.

Apache Hamilton helps data scientists and engineers define testable, modular, self-documenting dataflows, that encode lineage/tracing and metadata. Runs and scales everywhere python does.

Inspect: A framework for large language model evaluations

Data Contracts engine for the modern data stack. https://www.soda.io

Vendor-agnostic orchestration for training, inference and agentic workloads across NVIDIA, AMD, TPU, and Tenstorrent on clouds, Kubernetes, and bare metal.

VeOmni: Scaling Any Modality Model Training with Model-Centric Distributed Recipe Zoo

Numerical differential equation solvers in JAX. Autodifferentiable and GPU-capable. https://docs.kidger.site/diffrax/

Scalable toolkit for efficient model reinforcement

ContextGem: Effortless LLM extraction from documents

Developer Asset Hub for NVIDIA Nemotron — A one-stop resource for training recipes, usage cookbooks, datasets, and full end-to-end reference examples to build with Nemotron models

Agentic RL Training at Scale

Large-scale LLM inference engine

Lightweight and extensible compatibility layer between dataframe libraries!

MLRun is an open source MLOps platform for quickly building and managing continuous ML applications across their lifecycle. MLRun integrates into your development and CI/CD environment and automates the delivery of production data, ML pipelines, and online applications.

A fast and lightweight framework for creating decentralized agents with ease.

Open-source, end-to-end platform for evaluating, observing, and improving LLM and AI agent applications. Tracing · Evals · Simulations · Datasets · Gateway · Guardrails. Self-hostable. Apache 2.0.

The LLM Anti-Framework

bloom - evaluate any behavior immediately  🌸🌱