Awesome Opensource Ai

Infinity is a high-throughput, low-latency serving engine for text-embeddings, reranking models, clip, clap and colpali

Holistic Evaluation of Language Models (HELM) is an open source Python framework created by the Center for Research on Foundation Models (CRFM) at Stanford for holistic, reproducible and transparent evaluation of foundation models, including large language models (LLMs) and multimodal models.

The hub for EleutherAI's work on interpretability and learning dynamics

Stateful agents that are like people, with memory, identity, and the ability to learn and adapt

A training framework for Stable Baselines3 reinforcement learning agents, with hyperparameter optimization and pre-trained agents included.

A comprehensive set of fairness metrics for datasets and machine learning models, explanations for these metrics, and algorithms to mitigate bias in datasets and models.

The pretty much "official" DSPy framework for Typescript

Ruler — apply the same rules to all coding agents

pingcap/autoflow is a Graph RAG based and conversational knowledge base tool built with TiDB Serverless Vector Storage. Demo: https://tidb.ai

PentestAgent is an AI agent framework for black-box security testing, supporting bug bounty, red-team, and penetration testing workflows.

A library for debugging/inspecting machine learning classifiers and explaining their predictions

Minimalistic large language model 3D-parallelism training

Probabilistic programming with NumPy powered by JAX for autograd and JIT compilation to GPU/TPU/CPU.

Kubernetes-native Job Queueing

The code used to train and run inference with the ColVision models, e.g. ColPali, ColQwen2, and ColSmol.

nanoflann: a C++11 header-only library for Nearest Neighbor (NN) search with KD-trees

Open source platform for AI Engineering: OpenTelemetry-native LLM Observability, GPU Monitoring, Guardrails, Evaluations, Prompt Management, Vault, Playground. 🚀💻 Integrates with 50+ LLM Providers, VectorDBs, Agent Frameworks and GPUs.

Maid is a free and open source application for interfacing with llama.cpp models locally, and with Anthropic, DeepSeek, Ollama, Mistral and OpenAI models remotely.

[NeurIPS 2025] OmniSVG is the first family of end-to-end multimodal SVG generators that leverage pre-trained Vision-Language Models (VLMs), capable of generating complex and detailed SVGs, from simple icons to intricate anime characters.

Modular Python framework for AI agents and workflows with chain-of-thought reasoning, tools, and memory.

Apache Hamilton helps data scientists and engineers define testable, modular, self-documenting dataflows, that encode lineage/tracing and metadata. Runs and scales everywhere python does.

An Open Standard for lineage metadata collection

Build applications that make decisions (chatbots, agents, simulations, etc...). Monitor, trace, persist, and execute on your own infrastructure.

Lighteval is your all-in-one toolkit for evaluating LLMs across multiple backends

🤗 Evaluate: A library for easily evaluating machine learning models and datasets.

Machine learning metrics for distributed, scalable PyTorch applications.

SDG is a specialized framework designed to generate high-quality structured tabular data.

Data Contracts engine for the modern data stack. https://www.soda.io

Inspect: A framework for large language model evaluations

Python & JS/TS SDK for running AI-generated code/code interpreting in your AI app

Bionic is an on-premise replacement for ChatGPT, offering the advantages of Generative AI while maintaining strict data confidentiality

Fully open data curation for reasoning models

A Python package to assess and improve fairness of machine learning models.

Feature engineering and selection open-source Python library compatible with sklearn.

Collect, aggregate, and visualize a data ecosystem's metadata

An open coding agent for your terminal, built by a community collective rather than a company. Bring your own model, keep your code on your machine, and owe nothing to anyone.

cuGraph - RAPIDS Graph Analytics Library

An AI-powered agentic red team framework that automates offensive security operations, from reconnaissance to exploitation to post-exploitation, with zero human intervention.

TFX is an end-to-end platform for deploying production ML pipelines

Vendor-agnostic orchestration for training, inference and agentic workloads across NVIDIA, AMD, TPU, and Tenstorrent on clouds, Kubernetes, and bare metal.

Research project. A Memory solution for users, teams, and applications.

Fractal Graph-of-Thought. Rhizomatic Mind-Mapping for Ai-Agents, Web-Links, Notes, and Code.

Moonshot's most powerful model

Vim plugin for LLM-assisted code/text completion

Production-grade 3D gaussian splatting with CPU/GPU support for Windows, Mac and Linux 🚀

VeOmni: Scaling Any Modality Model Training with Model-Centric Distributed Recipe Zoo

Numerical differential equation solvers in JAX. Autodifferentiable and GPU-capable. https://docs.kidger.site/diffrax/

Enforce the output format (JSON Schema, Regex etc) of a language model

The Agentic Framework of the PHP ecosystem to build production-ready AI driven applications. Connect components (LLMs, Tools, vector DBs, memory) to agents that can interact with your data.

DeepTeam is a framework to red team LLMs and AI agents.