Awesome Opensource Ai

🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, for both inference and training.

The most powerful and modular diffusion model GUI, api and backend with a graph/nodes interface.

A high-throughput and memory-efficient inference and serving engine for LLMs

Deep Learning for humans

Ultralytics YOLO26, YOLO11, YOLOv8 — object detection, instance segmentation, semantic segmentation, image classification, pose estimation, object tracking

Clone a voice in 5 seconds to generate arbitrary speech in real-time

Learn how to develop, deploy and iterate on production-grade ML applications.

We write your reusable computer vision tools. 💜

Ray is an AI compute engine. Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads.

DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.

VoxCPM2: Tokenizer-Free TTS for Multilingual Speech Generation, Creative Voice Design, and True-to-Life Cloning

🤗 Diffusers: State-of-the-art diffusion models for image, video, and audio generation in PyTorch.

Pretrain, finetune ANY AI model of ANY size on 1 or 10,000+ GPUs with zero code changes.

The fastai deep learning library

Graph Neural Network Library for PyTorch

ncnn is a high-performance neural network inference framework optimized for the mobile platform

🤗 The largest hub of ready-to-use datasets for AI models with fast, easy-to-use and efficient data manipulation tools

🤗 PEFT: State-of-the-art Parameter-Efficient Fine-Tuning.

Open standard for machine learning interoperability

ONNX Runtime: cross-platform, high performance ML inferencing and training accelerator

FinGPT: Open-Source Financial Large Language Models! Revolutionize 🔥 We release the trained model on HuggingFace.

Open-source speech recognition toolkit for training, inference, streaming ASR, VAD, punctuation, speaker diarization pipelines, and OpenAI-compatible/MCP serving.

Materials for the Learn PyTorch for Deep Learning: Zero to Mastery course.

Private AI platform for agents, assistants and enterprise search. Built-in Agent Builder, Deep research, Document analysis, Multi-model support, and API connectivity for agents.

Computer Vision Annotation Tool (CVAT) is a leading platform for building high-quality visual datasets for vision AI. It offers open-source, cloud, and enterprise products, as well as labeling services, for image, video, and 3D annotation with AI-assisted labeling, quality assurance, team collaboration, analytics, and developer APIs.

Burn is a next generation tensor library and Deep Learning Framework that doesn't compromise on flexibility, efficiency and portability.

Nano vLLM

RWKV (pronounced RwaKuv) is an RNN with great LLM performance, which can also be directly trained like a GPT transformer (parallelizable). We are at RWKV-7 "Goose". So it's combining the best of RNN and transformer - great performance, linear time, constant space (no kv-cache), fast training, infinite ctx_len, and free sentence embedding.

TensorRT LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and supports state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. TensorRT LLM also contains components to create Python and C++ runtimes that orchestrate the inference execution in a performant way.

An open source implementation of CLIP.

Open3D: A Modern Library for 3D Data Processing

PyTorch version of Stable Baselines, reliable implementations of reinforcement learning algorithms.

Low-code framework for building custom LLMs, neural networks, and other AI models

A PyTorch-based Speech Toolkit

This repository contains demos I made with the Transformers library by HuggingFace.

🐍 Geometric Computer Vision Library for Spatial AI

LMCache: Supercharge Your LLM with the Fastest KV Cache Layer

An elegant PyTorch deep reinforcement learning library.

Fast and Accurate ML in 3 Lines of Code

Flexible and powerful tensor operations for readable and reliable code (for pytorch, jax, TF and others)

Swap GPT for any LLM by changing a single line of code. Xinference lets you run open-source, speech, and multimodal models on cloud, on-prem, or your laptop — all through one unified, production-ready inference API.

Containers for machine learning

Deeplake is AI Data Runtime for Agents. It provides serverless postgres with a multimodal datalake, enabling scalable retrieval and training.

AI Toolkit for Healthcare Imaging

An Extensible Toolkit for Finetuning and Inference of Large Foundation Models. Large Models for All.

Accessible large language models via k-bit quantization for PyTorch.

Stanford NLP Python library for tokenization, sentence segmentation, NER, and parsing of many human languages

Aim 💫 — An easy-to-use & supercharged open-source experiment tracker.

A scikit-learn compatible neural network library that wraps PyTorch

FlashInfer: Kernel Library for LLM Serving