Awesome Opensource Ai

The AI Compute Platform for frontier teams. SkyPilot turns fragmented AI compute into one AI supercomputer, so frontier AI teams build custom intelligence faster.

Streamlined interface for generating images with AI in Krita. Inpaint and outpaint with optional text prompt, no tweaking required.

Modin: Scale your Pandas workflows by changing a single line of code

Build, Manage and Deploy AI/ML Systems

Amphion (/æmˈfaɪən/) is a toolkit for Audio, Music, and Speech Generation. Its purpose is to support reproducible research and help junior researchers and engineers get started in the field of audio, music, and speech generation research and development.

A unified framework for machine learning with time series

PyTorch3D is FAIR's library of reusable components for deep learning with 3D data

tiny vision language model

An Easy-to-use, Scalable and High-performance Agentic RL Framework based on Ray (PPO & DAPO & REINFORCE++ & VLM & TIS & vLLM & Ray & Async RL)

🚀 A simple way to launch, train, and use PyTorch models on almost any device and distributed configuration, automatic mixed precision (including fp8), and easy-to-configure FSDP and DeepSpeed support

Bayesian Modeling and Probabilistic Programming in Python

High-speed Large Language Model Serving for Local Deployment

Cybersecurity AI (CAI), the framework for AI Security

Swap GPT for any LLM by changing a single line of code. Xinference lets you run open-source, speech, and multimodal models on cloud, on-prem, or your laptop — all through one unified, production-ready inference API.

Containers for machine learning

Easy-to-use image segmentation library with awesome pre-trained model zoo, supporting wide-range of practical tasks in Semantic Segmentation, Interactive Segmentation, Panoptic Segmentation, Image Matting, 3D Segmentation, etc.

AutoML library for deep learning

Deeplake is AI Data Runtime for Agents. It provides serverless postgres with a multimodal datalake, enabling scalable retrieval and training.

Apache Iceberg

ModelScope: bring the notion of Model-as-a-Service to life.

A fast, scalable, high performance Gradient Boosting on Decision Trees library, used for ranking, classification, regression and other machine learning tasks for Python, R, Java, C++. Supports computation on CPU and GPU.

🤖 AI Gateway | AI Native API Gateway

A PyTorch Extension: Tools for easy mixed precision and distributed training in Pytorch

KAG is a logical form-guided reasoning and retrieval framework based on OpenSPG engine and LLMs. It is used to build logical reasoning and factual Q&A solutions for professional domain knowledge bases. It can effectively overcome the shortcomings of the traditional RAG vector similarity calculation model.

An open-source storage framework that enables building a Lakehouse architecture with compute engines including Spark, PrestoDB, Flink, Trino, and Hive and APIs

the LLM vulnerability scanner

🧙 Build, run, and manage data pipelines for integrating and transforming data.

The easiest way to serve AI apps and models - Build Model Inference APIs, Job queues, LLM apps, Multi-model pipelines, and more!

No description.

Apache Beam is a unified programming model for Batch and Streaming data processing.

[NeurIPS 2024] Depth Anything V2. A More Capable Foundation Model for Monocular Depth Estimation

AI Toolkit for Healthcare Imaging

PraisonAI 🦞 — Hire a 24/7 AI Workforce. Stop writing boilerplate and start shipping autonomous self-improving agents that research, plan, code, and execute tasks. Deployed in 5 lines of code with built-in memory, RAG, and support for 100+ LLMs.

Out-of-Core hybrid Apache Arrow/NumPy DataFrame for Python, ML, visualization and exploration of big tabular data at a billion rows per second 🚀

Build effective agents using Model Context Protocol and simple workflow patterns

An Extensible Toolkit for Finetuning and Inference of Large Foundation Models. Large Models for All.

Accessible large language models via k-bit quantization for PyTorch.

LMDeploy is a toolkit for compressing, deploying, and serving LLMs.

A vector search SQLite extension that runs anywhere!

FinRobot: An Open-Source AI Agent Platform for Financial Applications using Large Language Models

Stanford NLP Python library for tokenization, sentence segmentation, NER, and parsing of many human languages

Unified framework for robot learning built on NVIDIA Isaac Sim

Evidently is ​​an open-source ML and LLM observability framework. Evaluate, test, and monitor any AI-powered system or data pipeline. From tabular data to Gen AI. 100+ metrics.

slime is an LLM post-training framework for RL Scaling.

Flexible and powerful framework for managing multiple AI agents and handling complex conversations

Utilities intended for use with Llama models.

An open source python library for automated feature engineering

A Datacenter Scale Distributed Inference Serving Framework

No description.

An implementation of model parallel autoregressive transformers on GPUs, based on the Megatron and DeepSpeed libraries