Awesome Opensource Ai

An Open Source Machine Learning Framework for Everyone

Get up and running with Kimi-K2.6, GLM-5.2, MiniMax, DeepSeek, gpt-oss, Qwen, Gemma and other models.

LLM inference in C/C++

Tensors and Dynamic neural networks in Python with strong GPU acceleration

Open Source Computer Vision Library

A high-throughput and memory-efficient inference and serving engine for LLMs

RAGFlow is a leading open-source Retrieval-Augmented Generation (RAG) engine that fuses cutting-edge RAG with Agent capabilities to create a superior context layer for LLMs

Ultralytics YOLO26, YOLO11, YOLOv8 — object detection, instance segmentation, semantic segmentation, image classification, pose estimation, object tracking

LocalAI is the open-source AI engine. Run any model - LLMs, vision, voice, image, video - on any hardware. No GPU required.

Milvus is a high-performance, cloud-native vector database built for scalable vector ANN search

A library for efficient similarity search and clustering of dense vectors.

DuckDB is an analytical in-process SQL database management system

Official inference framework for 1-bit LLMs

Composable transformations of Python+NumPy programs: differentiate, vectorize, JIT to GPU/TPU, and more

Self-evolving Context Database for AI Agents. Unify Agent Memory, Knowledge RAG and Skills.

Detectron2 is a platform for object detection, segmentation and other visual recognition tasks.

The fundamental package for scientific computing with Python.

SGLang is a high-performance serving framework for large language models and multimodal models.

Privacy first, AI meeting assistant with 4x faster Parakeet/Whisper live transcription, speaker diarization, and Ollama summarization built on Rust. 100% local processing. no cloud required. Meetily (Meetly Ai - https://meetily.ai) is the #1 Self-hosted, Open-source Ai meeting note taker for macOS & Windows. Understand How to write meeting minutes

Scalable, Portable and Distributed Gradient Boosting (GBDT, GBRT or GBM) Library, for Python, R, Java, Scala, C and more. Runs on single machine, Hadoop, Spark, Dask, Flink and DataFlow

MLX: An array framework for Apple silicon

Open Source alternative to Algolia + Pinecone and an Easier-to-Use alternative to ElasticSearch ⚡ 🔍 ✨ Fast, typo tolerant, in-memory fuzzy Search Engine for building delightful search experiences

A game theoretic approach to explain the output of any machine learning model.

PArallel Distributed Deep LEarning: Machine Learning Framework from Industrial Practice （『飞桨』核心框架，深度学习&机器学习高性能单机、分布式训练和跨平台部署）

Graph Neural Network Library for PyTorch

ncnn is a high-performance neural network inference framework optimized for the mobile platform

Universal LLM Deployment Engine with ML Compilation

Open standard for machine learning interoperability

ONNX Runtime: cross-platform, high performance ML inferencing and training accelerator

gpt-oss-120b and gpt-oss-20b are two open-weight language models by OpenAI

Development repository for the Triton language and compiler

Open-source speech recognition toolkit for training, inference, streaming ASR, VAD, punctuation, speaker diarization pipelines, and OpenAI-compatible/MCP serving.

A Flexible Framework for Experiencing Heterogeneous LLM Inference/Fine-tune Optimizations

A fast, distributed, high performance gradient boosting (GBT, GBDT, GBRT, GBM or MART) framework based on decision tree algorithms, used for ranking, classification and many other machine learning tasks.

Datasets, Transforms and Models specific to Computer Vision

MNN: A blazing-fast, lightweight inference engine battle-tested by Alibaba, powering high-performance on-device LLMs and Edge AI.

A lightweight, lightning-fast, in-process vector database

Tensor library for machine learning

Multi-Joint dynamics with Contact. A general purpose physics simulator.

TensorRT LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and supports state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. TensorRT LLM also contains components to create Python and C++ runtimes that orchestrate the inference execution in a performant way.

Open-source simulator for autonomous driving research.

Open3D: A Modern Library for 3D Data Processing

Open Machine Learning Compiler Framework

Easy-to-use and powerful LLM and SLM library with awesome model zoo.

Open-source search database for full-text, vector, and hybrid search with real-time indexing and SQL.

A framework for building realtime voice AI agents 🤖🎙️📹

Run GGUF models easily with a KoboldAI UI. One File. Zero Install.

Point Cloud Library (PCL)

LMCache: Supercharge Your LLM with the Fastest KV Cache Layer

The Triton Inference Server provides an optimized cloud and edge inferencing solution.