Awesome Opensource Ai

Mooncake is the serving platform for Kimi, a leading LLM service provided by Moonshot AI.

FlashInfer: Kernel Library for LLM Serving

A system for quickly generating training data with weak supervision

Optimize prompts, code, and more with AI-powered Reflective Optimization

A simple SWE style browser agent framework that achieves SOTA results on long horizon web tasks.

Open-source scientific and technical publishing system built on Pandoc.

A treasure chest for visual classification and recognition powered by PaddlePaddle

Python SDK for AI agent monitoring, LLM cost tracking, benchmarking, and more. Integrates with most LLMs and agent frameworks including CrewAI, Agno, OpenAI Agents SDK, Langchain, Autogen, AG2, and CamelAI

PyTorch native post-training library

Standardized Distributed Generative and Predictive AI Inference Platform for Scalable, Multi-Framework Deployment on Kubernetes

Democratizing Reinforcement Learning for LLMs

A GPU-accelerated library containing highly optimized building blocks and an execution engine for data processing to accelerate deep learning training and inference applications.

🐢 Open-Source Evaluation & Testing library for LLM Agents

HelixDB is an OLTP graph-vector database built in Rust on Object Storage.

Model interpretability and understanding for PyTorch

Chronos: Pretrained Models for Time Series Forecasting

Gemma open-weight LLM library, from Google DeepMind

A PyTorch native platform for training generative AI models

AI Agent Governance Toolkit — Policy enforcement, zero-trust identity, execution sandboxing, and reliability engineering for autonomous AI agents. Covers 10/10 OWASP Agentic Top 10.

SWE-bench: Can Language Models Resolve Real-world Github Issues?

Supercharge Your Model Training

CUDA accelerated rasterization of gaussian splatting

The CLI and skills that turn any coding assistant into an expert at creating, evaluating, and deploying AI agents on Google Cloud.

OpenSpiel is a collection of environments and algorithms for research in general reinforcement learning and search/planning in games.

Header-only C++/python library for fast approximate nearest neighbors

cuML - RAPIDS Machine Learning Library

Simple and Distributed Machine Learning

A Next-Generation Training Engine Built for Ultra-Large MoE Models

Argilla is a collaboration tool for AI engineers and domain experts to build high-quality datasets

Ecommerce Search and Discovery - marqo.ai

A blazing fast inference solution for text embeddings models

Time series forecasting with PyTorch

Lightning ⚡️ fast forecasting with statistical and econometric models.

On-device AI across mobile, embedded and edge for PyTorch

An Engine-Agnostic Deep Learning Framework in Java

High-level library to help with training and evaluating neural networks in PyTorch flexibly and transparently.

Agenta is a workspace where you and your team build agents and automations.

Align Anything: Training All-modality Model with Feedback

A compact implementation of SGLang, designed to demystify the complexities of modern LLM serving systems.

The AI-native database built for LLM applications, providing incredibly fast hybrid search of dense vector, sparse vector, tensor (multi-vector), and full-text.

Prompt Engineering | Prompt Versioning | Use GPT or other prompt based models to get structured output. Join our discord for Prompt-Engineering, LLMs and other latest research

Fast inference engine for Transformer models

LLM training code for Databricks foundation models

Pre-trained Deep Learning models and demos (high quality and extremely fast)

Your agent in your terminal, equipped with local tools: writes code, uses the terminal, browses the web. Make your own persistent autonomous agent on top!

A fast library for AutoML and tuning. Join our Discord: https://discord.gg/Cppx2vSPVP.

A full-stack AI Red Teaming platform securing AI ecosystems via OpenClaw Security Scan, Agent Scan, Skills Scan, MCP scan, AI Infra scan and LLM jailbreak evaluation.

An open source extension that connects AI agents to computational notebooks in JupyterLab.

Set of tools to assess and improve LLM security.

Optimizing inference proxy for LLMs