Awesome Opensource Ai

Modeling, training, eval, and inference code for OLMo

Code for the paper "Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer"

Efficient Triton Kernels for LLM Training

TensorFlow documentation

Upserts, Deletes And Incremental Processing on Big Data.

Aim 💫 — An easy-to-use & supercharged open-source experiment tracker.

A query and indexing engine for Redis, providing secondary indexing, full-text search, vector similarity search and aggregations.

A scikit-learn compatible neural network library that wraps PyTorch

🐬DeepChat - A smart assistant that connects powerful AI to your personal world

Adversarial Robustness Toolbox (ART) - Python Library for Machine Learning Security - Evasion, Poisoning, Extraction, Inference - Red and Blue Teams

结合知识库、知识图谱管理的 多租户 Agent Harness 平台。 An agent harness that integrates a LightRAG knowledge base and knowledge graphs. Build with LangChain + Vue + FastAPI, support DeepAgents、MinerU PDF、Neo4j 、MCP.

A system for quickly generating training data with weak supervision

🧊 Open source LLM observability platform. One line of code to monitor, evaluate, and experiment. YC W23 🍓

FlashInfer: Kernel Library for LLM Serving

LiteRT-LM is Google's production-ready, high-performance, open-source inference framework for deploying Large Language Models on edge devices.

Open-source scientific and technical publishing system built on Pandoc.

Mooncake is the serving platform for Kimi, a leading LLM service provided by Moonshot AI.

A treasure chest for visual classification and recognition powered by PaddlePaddle

An automated document analyzer for Paperless-ngx using OpenAI API, Ollama, Deepseek-r1, Azure and all OpenAI API compatible Services to automatically analyze and tag your documents.

PyTorch native post-training library

A GPU-accelerated library containing highly optimized building blocks and an execution engine for data processing to accelerate deep learning training and inference applications.

Python SDK for AI agent monitoring, LLM cost tracking, benchmarking, and more. Integrates with most LLMs and agent frameworks including CrewAI, Agno, OpenAI Agents SDK, Langchain, Autogen, AG2, and CamelAI

Standardized Distributed Generative and Predictive AI Inference Platform for Scalable, Multi-Framework Deployment on Kubernetes

Optimize prompts, code, and more with AI-powered Reflective Text Evolution

⚡ Pure-Rust WebGPU inference engine — OpenAI-API compatible, GGUF native, runs on any GPU. No Python. No llama.cpp. Single binary.

Robust recipes to align language models with human and AI preferences

Gemma open-weight LLM library, from Google DeepMind

A PyTorch native platform for training generative AI models

Supercharge Your Model Training

lakeFS - Data version control for your data lake | Git for data

⚡️next-generation personal AI assistant powered by LLM, RAG and agent loops, supporting computer-use, browser-use and coding agent, demo: https://demo.openagentai.org

CUDA accelerated rasterization of gaussian splatting

OpenSpiel is a collection of environments and algorithms for research in general reinforcement learning and search/planning in games.

Header-only C++/python library for fast approximate nearest neighbors

A GPU cluster manager for high-performance AI model serving (vLLM, SGLang) and on-demand SSH-accessible GPU instances.

Simple and Distributed Machine Learning

Astronomy and astrophysics core library

Probabilistic time series modeling in Python

Visualizer for pandas data structures

A Next-Generation Training Engine Built for Ultra-Large MoE Models

Argilla is a collaboration tool for AI engineers and domain experts to build high-quality datasets

Ecommerce Search and Discovery - marqo.ai

A distributed approximate nearest neighborhood search (ANN) library which provides a high quality vector index build, search and distributed online serving toolkits for large scale vector search scenario.

A blazing fast inference solution for text embeddings models

AI Agent Governance Toolkit — Policy enforcement, zero-trust identity, execution sandboxing, and reliability engineering for autonomous AI agents. Covers 10/10 OWASP Agentic Top 10.

AutoRAG: An Open-Source Framework for Retrieval-Augmented Generation (RAG) Evaluation & Optimization with AutoML-Style Automation

Lightning ⚡️ fast forecasting with statistical and econometric models.

An Engine-Agnostic Deep Learning Framework in Java

On-device AI across mobile, embedded and edge for PyTorch

Amundsen is a metadata driven application for improving the productivity of data analysts, data scientists and engineers when interacting with data.