Awesome Opensource Ai

A nearly-live implementation of OpenAI's Whisper.

LightLLM is a Python-based LLM (Large Language Model) inference and serving framework, notable for its lightweight design, easy scalability, and high-speed performance.

🦛 CHONK docs with Chonkie ✨ — The lightweight ingestion library for fast, efficient and robust RAG pipelines

AdalFlow: The library to build & auto-optimize LLM applications.

Next Generation Agentic Proxy for AI Agents and MCP servers

An AI Gateway, registry, and proxy that sits in front of any MCP, A2A, or REST/gRPC APIs, exposing a unified endpoint with centralized discovery, guardrails and management. Optimizes Agent & Tool calling, and supports plugins.

Machine Learning Pipelines for Kubeflow

Heterogeneous GPU Sharing on Kubernetes

Official repository for the Boltz biomolecular interaction models

TorchGeo: datasets, samplers, transforms, and pre-trained models for geospatial data

Harness LLMs with Multi-Agent Programming

A system for agentic LLM-powered data processing and ETL

Deepchecks: Tests for Continuous Validation of ML Models & Data. Deepchecks is a holistic open-source solution for all of your AI & ML validation needs, enabling to thoroughly test your data and models from research to production.

Achieve state of the art inference performance with modern accelerators on Kubernetes

OpenAgents - AI Agent Networks for Open Collaboration

RTAB-Map library and standalone application

A minimal Python framework for building custom AI inference servers with full control over logic, batching, and scaling.

Simple RL training for reasoning

A retargetable MLIR-based machine learning compiler and runtime toolkit.

Agent framework for the JVM. Pronounced Em-BAY-bel /ɛmˈbeɪbəl/

VILA is a family of state-of-the-art vision language models (VLMs) for diverse multimodal AI tasks across the edge, data center, and cloud.

Simple, safe way to store and distribute tensors

Generative models for conditional audio generation

Maestro: Netflix’s Workflow Orchestrator

This is a Phi Family of SLMs book for getting started with Phi Models. Phi a family of open sourced AI models developed by Microsoft. Phi models are the most capable and cost-effective small language models (SLMs) available, outperforming models of the same size and next size up across a variety of language, reasoning, coding, and math benchmarks

The official CLI and Python client for the Hugging Face Hub.

Framework for evaluating and improving agents

A flexible, high-performance 3D simulator for Embodied AI research.

Superfast AI decision making and intelligent processing of multi-modal data.

Open-source security automation platform for teams and AI agents

Qwen3.6 is the large language model series developed by Qwen team, Alibaba Group.

A library for mechanistic interpretability of GPT-style language models

Input OpenAPI. Output SDKs and Docs.

AI Infra / AI Orchestration / AI Control Plane

The best OSS video generation models, created by Genmo

Open-source multimodal retrieval engine (Morphik Core). By Morphik — AI back office for skilled nursing & senior living (morphik.ai).

Fully customizable AI chatbot component for your website

Deequ is a library built on top of Apache Spark for defining "unit tests for data", which measure data quality in large datasets.

A Comprehensive Benchmark to Evaluate LLMs as Agents (ICLR'24)

Non-Metric Space Library (NMSLIB): An efficient similarity search library and a toolkit for evaluation of k-NN methods for generic non-metric spaces.

Quickly and accurately render even the largest data.

Personal AI Notebooks. Organize files & webpages and generate notes from them. Open source, local & open data, open model choice (incl. local).

AI Agent that handles engineering tasks end-to-end: integrates with developers’ tools, plans, executes, and iterates until it achieves a successful result.

⚡FlashRAG: A Python Toolkit for Efficient RAG Research (WWW2025 Resource)

Synthetic data generation for tabular data

DeepResearchAgent is a hierarchical multi-agent system designed not only for deep research tasks but also for general-purpose task solving. The framework leverages a top-level planning agent to coordinate multiple specialized lower-level agents, enabling automated task decomposition and efficient execution across diverse and complex domains.

Evaluation and Tracking for LLM Experiments and AI Agents

Train, inspect, edit, automate, and export 3D Gaussian Splatting scenes from a single native application.

TextAttack 🐙 is a Python framework for adversarial attacks, data augmentation, and model training in NLP https://textattack.readthedocs.io/en/master/

🚀 Accelerate inference and training of 🤗 Transformers, Diffusers, TIMM and Sentence Transformers with easy to use hardware optimization tools