Awesome Opensource Ai

An Easy-to-use, Scalable and High-performance Agentic RL Framework based on Ray (PPO & DAPO & REINFORCE++ & VLM & TIS & vLLM & Ray & Async RL)

🚀 A simple way to launch, train, and use PyTorch models on almost any device and distributed configuration, automatic mixed precision (including fp8), and easy-to-configure FSDP and DeepSpeed support

cuDF - GPU DataFrame Library

Bayesian Modeling and Probabilistic Programming in Python

High-speed Large Language Model Serving for Local Deployment

Multi-platform SDK for integrating GitHub Copilot Agent into apps and services

Containers for machine learning

Swap GPT for any LLM by changing a single line of code. Xinference lets you run open-source, speech, and multimodal models on cloud, on-prem, or your laptop — all through one unified, production-ready inference API.

Easy-to-use image segmentation library with awesome pre-trained model zoo, supporting wide-range of practical tasks in Semantic Segmentation, Interactive Segmentation, Panoptic Segmentation, Image Matting, 3D Segmentation, etc.

Easily fine-tune, evaluate and deploy Gemma 4, Qwen3.5, Qwen3.6, gpt-oss, DeepSeek-R1, or any open source LLM / VLM!

AutoML library for deep learning

Kimi Code CLI is your next CLI agent.

ModelScope: bring the notion of Model-as-a-Service to life.

A fast, scalable, high performance Gradient Boosting on Decision Trees library, used for ranking, classification, regression and other machine learning tasks for Python, R, Java, C++. Supports computation on CPU and GPU.

A PyTorch Extension: Tools for easy mixed precision and distributed training in Pytorch

An open-source storage framework that enables building a Lakehouse architecture with compute engines including Spark, PrestoDB, Flink, Trino, and Hive and APIs

KAG is a logical form-guided reasoning and retrieval framework based on OpenSPG engine and LLMs. It is used to build logical reasoning and factual Q&A solutions for professional domain knowledge bases. It can effectively overcome the shortcomings of the traditional RAG vector similarity calculation model.

🧙 Build, run, and manage data pipelines for integrating and transforming data.

No description.

Apache Beam is a unified programming model for Batch and Streaming data processing.

Out-of-Core hybrid Apache Arrow/NumPy DataFrame for Python, ML, visualization and exploration of big tabular data at a billion rows per second 🚀

An Extensible Toolkit for Finetuning and Inference of Large Foundation Models. Large Models for All.

PraisonAI 🦞 — Hire a 24/7 AI Workforce. Stop writing boilerplate and start shipping autonomous self-improving agents that research, plan, code, and execute tasks. Deployed in 5 lines of code with built-in memory, RAG, and support for 100+ LLMs.

Build effective agents using Model Context Protocol and simple workflow patterns

AI Toolkit for Healthcare Imaging

the LLM vulnerability scanner

Accessible large language models via k-bit quantization for PyTorch.

LMDeploy is a toolkit for compressing, deploying, and serving LLMs.

A vector search SQLite extension that runs anywhere!

Evidently is ​​an open-source ML and LLM observability framework. Evaluate, test, and monitor any AI-powered system or data pipeline. From tabular data to Gen AI. 100+ metrics.

Flexible and powerful framework for managing multiple AI agents and handling complex conversations

Unified framework for robot learning built on NVIDIA Isaac Sim

An open source python library for automated feature engineering

Utilities intended for use with Llama models.

A Datacenter Scale Distributed Inference Serving Framework

slime is an LLM post-training framework for RL Scaling.

Fast, flexible LLM inference

Flax is a neural network library for JAX that is designed for flexibility.

Dynamic, resilient AI orchestration. Coordinate data, models, and compute as you build AI workflows.

The Open Source Feature Store for AI/ML

Fit interpretable models. Explain blackbox machine learning.

NeMo Guardrails is an open-source toolkit for easily adding programmable guardrails to LLM-based conversational systems.

the portable Python dataframe library

Julep — durable, composable AI agents. Flows that crash and resume, retry safely, and explain every step.

Modeling, training, eval, and inference code for OLMo

Efficient Triton Kernels for LLM Training

Aim 💫 — An easy-to-use & supercharged open-source experiment tracker.

an ambient intelligence library

A query and indexing engine for Redis, providing secondary indexing, full-text search, vector similarity search and aggregations.

A scikit-learn compatible neural network library that wraps PyTorch