Awesome Opensource Ai

Kimi Code CLI is your next CLI agent.

Developer-friendly OSS embedded retrieval library for multimodal AI. Search More; Manage Less.

Multi-Agent Harness for Production AI

LMCache: Supercharge Your LLM with the Fastest KV Cache Layer

AI Observability & Evaluation

💥 Fast State-of-the-Art Tokenizers optimized for Research and Production

Kedro is a toolbox for production-ready data science. It uses software engineering best practices to help you create data engineering and data science pipelines that are reproducible, maintainable, and modular.

An elegant PyTorch deep reinforcement learning library.

The Triton Inference Server provides an optimized cloud and edge inferencing solution.

Official inference library for Mistral models

Official repository for LTX-Video

OpenVINO™ is an open source toolkit for optimizing and deploying AI inference

Python bindings for llama.cpp

Hackable and optimized Transformers building blocks, supporting a composable construction.

The AI Compute Platform for frontier teams. SkyPilot turns fragmented AI compute into one AI supercomputer, so frontier AI teams build custom intelligence faster.

An Open-Source Asynchronous Coding Agent

Streamlined interface for generating images with AI in Krita. Inpaint and outpaint with optional text prompt, no tweaking required.

Modin: Scale your Pandas workflows by changing a single line of code

Multi-platform SDK for integrating GitHub Copilot Agent into apps and services

A unified framework for machine learning with time series

cuDF - GPU DataFrame Library

Bayesian Modeling and Probabilistic Programming in Python

High-speed Large Language Model Serving for Local Deployment

Cybersecurity AI (CAI), the framework for AI Security

Swap GPT for any LLM by changing a single line of code. Xinference lets you run open-source, speech, and multimodal models on cloud, on-prem, or your laptop — all through one unified, production-ready inference API.

Containers for machine learning

Easily fine-tune, evaluate and deploy Qwen, Gemma, or any open weight LLM!

AutoML library for deep learning

Deeplake is AI Data Runtime for Agents. It provides serverless postgres with a multimodal datalake, enabling scalable retrieval and training.

A PyTorch Extension: Tools for easy mixed precision and distributed training in Pytorch

KAG is a logical form-guided reasoning and retrieval framework based on OpenSPG engine and LLMs. It is used to build logical reasoning and factual Q&A solutions for professional domain knowledge bases. It can effectively overcome the shortcomings of the traditional RAG vector similarity calculation model.

the LLM vulnerability scanner

🧙 Build, run, and manage data pipelines for integrating and transforming data.

The easiest way to serve AI apps and models - Build Model Inference APIs, Job queues, LLM apps, Multi-model pipelines, and more!

Apache Beam is a unified programming model for Batch and Streaming data processing.

AI Toolkit for Healthcare Imaging

PraisonAI 🦞 — Hire a 24/7 AI Workforce. Stop writing boilerplate and start shipping autonomous self-improving agents that research, plan, code, and execute tasks. Deployed in 5 lines of code with built-in memory, RAG, and support for 100+ LLMs.

Out-of-Core hybrid Apache Arrow/NumPy DataFrame for Python, ML, visualization and exploration of big tabular data at a billion rows per second 🚀

Build effective agents using Model Context Protocol and simple workflow patterns

Accessible large language models via k-bit quantization for PyTorch.

LMDeploy is a toolkit for compressing, deploying, and serving LLMs.

A vector search SQLite extension that runs anywhere!

Build autonomous AI agents in Python.

OpenShell is the safe, private runtime for autonomous AI agents.

Stanford NLP Python library for tokenization, sentence segmentation, NER, and parsing of many human languages

Evidently is ​​an open-source ML and LLM observability framework. Evaluate, test, and monitor any AI-powered system or data pipeline. From tabular data to Gen AI. 100+ metrics.

slime is an LLM post-training framework for RL Scaling.

Utilities intended for use with Llama models.

An open source python library for automated feature engineering

A Datacenter Scale Distributed Inference Serving Framework