Awesome Opensource Ai

An Open Source Machine Learning Framework for Everyone

Tensors and Dynamic neural networks in Python with strong GPU acceleration

Cross-platform, customizable ML solutions for live and streaming media.

Universal LLM Deployment Engine with ML Compilation

ONNX Runtime: cross-platform, high performance ML inferencing and training accelerator

Open-source speech recognition toolkit for training, inference, streaming ASR, VAD, punctuation, speaker diarization pipelines, and OpenAI-compatible/MCP serving.

MNN: A blazing-fast, lightweight inference engine battle-tested by Alibaba, powering high-performance on-device LLMs and Edge AI.

Open Machine Learning Compiler Framework

High-speed Large Language Model Serving for Local Deployment

Easy-to-use image segmentation library with awesome pre-trained model zoo, supporting wide-range of practical tasks in Semantic Segmentation, Interactive Segmentation, Panoptic Segmentation, Image Matting, 3D Segmentation, etc.

An app that brings language models directly to your phone.

A treasure chest for visual classification and recognition powered by PaddlePaddle

lakeFS - Data version control for your data lake | Git for data

An Engine-Agnostic Deep Learning Framework in Java

On-device AI across mobile, embedded and edge for PyTorch

Your agent in your terminal, equipped with local tools: writes code, uses the terminal, browses the web. Make your own persistent autonomous agent on top!

This is a Phi Family of SLMs book for getting started with Phi Models. Phi a family of open sourced AI models developed by Microsoft. Phi models are the most capable and cost-effective small language models (SLMs) available, outperforming models of the same size and next size up across a variety of language, reasoning, coding, and math benchmarks

llama.cpp fork with additional SOTA quants and improved performance

Maid is a free and open source application for interfacing with llama.cpp models locally, and with Anthropic, DeepSeek, Ollama, Mistral and OpenAI models remotely.