Awesome Opensource Ai

FlashInfer: Kernel Library for LLM Serving

A GPU-accelerated library containing highly optimized building blocks and an execution engine for data processing to accelerate deep learning training and inference applications.

Standardized Distributed Generative and Predictive AI Inference Platform for Scalable, Multi-Framework Deployment on Kubernetes

Supercharge Your Model Training

Probabilistic time series modeling in Python

Time series forecasting with PyTorch

An Engine-Agnostic Deep Learning Framework in Java

High-level library to help with training and evaluating neural networks in PyTorch flexibly and transparently.

A repository for storing models that have been inter-converted between various frameworks. Supported frameworks are TensorFlow, PyTorch, ONNX, OpenVINO, TFJS, TFTRT, TensorFlowLite (Float32/16/INT8), EdgeTPU, CoreML.

LLM training code for Databricks foundation models

Open-source evaluation toolkit of large multi-modality models (LMMs), support 220+ LMMs, 80+ benchmarks

TorchGeo: datasets, samplers, transforms, and pre-trained models for geospatial data

Deepchecks: Tests for Continuous Validation of ML Models & Data. Deepchecks is a holistic open-source solution for all of your AI & ML validation needs, enabling to thoroughly test your data and models from research to production.

A retargetable MLIR-based machine learning compiler and runtime toolkit.

The official Python client for the Hugging Face Hub.

AI Infra / AI Orchestration / AI Control Plane

🚀 Accelerate inference and training of 🤗 Transformers, Diffusers, TIMM and Sentence Transformers with easy to use hardware optimization tools

Trainable, memory-efficient, and GPU-friendly PyTorch reproduction of AlphaFold 2

Open-source deep-learning framework for building, training, and fine-tuning deep learning models using state-of-the-art Physics-ML methods

PyTorch native quantization and sparsity for training and inference

Data manipulation and transformation for audio signal processing, powered by PyTorch

A training framework for Stable Baselines3 reinforcement learning agents, with hyperparameter optimization and pre-trained agents included.

Machine learning metrics for distributed, scalable PyTorch applications.

Automated Machine Learning on Kubernetes

A Data Streaming Library for Efficient Neural Network Training

The good ol' Forge WebUI, now updated with new features~

An open source DevOps tool from the CNCF for packaging and versioning AI/ML models, datasets, code, and configuration into an OCI Artifact.

Scalable and memory-optimized training of diffusion models

FAIR Sequence Modeling Toolkit 2