Awesome Opensource Ai

Low-code framework for building custom LLMs, neural networks, and other AI models

TensorZero is an open-source LLMOps platform that unifies an LLM gateway, observability, evaluation, optimization, and experimentation.

A PyTorch-based Speech Toolkit

Cleanlab's open-source library is the standard data-centric AI package for data quality and machine learning with messy, real-world data and labels.

Always know what to expect from your data.

A framework for building realtime voice AI agents 🤖🎙️📹

Unity MCP acts as a bridge between AI assistants and your Unity Editor. Give your LLM tools to manage assets, control scenes, edit scripts, and automate tasks within Unity.

🐍 Geometric Computer Vision Library for Spatial AI

Build high-quality LLM apps - from prototyping, testing to production deployment and monitoring.

Run GGUF models easily with a KoboldAI UI. One File. Zero Install.

Developer-friendly OSS embedded retrieval library for multimodal AI. Search More; Manage Less.

💥 Fast State-of-the-Art Tokenizers optimized for Research and Production

An elegant PyTorch deep reinforcement learning library.

Multi-Agent Harness for Production AI

Official repository for LTX-Video

OpenVINO™ is an open source toolkit for optimizing and deploying AI inference

Hackable and optimized Transformers building blocks, supporting a composable construction.

Python bindings for llama.cpp

Modin: Scale your Pandas workflows by changing a single line of code

AI Observability & Evaluation

Streamlined interface for generating images with AI in Krita. Inpaint and outpaint with optional text prompt, no tweaking required.

Run, manage, and scale AI workloads on any AI infrastructure. Use one system to access & manage all AI compute (Kubernetes, Slurm, 20+ clouds, on-prem).

A unified framework for machine learning with time series

cuDF - GPU DataFrame Library

Bayesian Modeling and Probabilistic Programming in Python

High-speed Large Language Model Serving for Local Deployment

Multi-platform SDK for integrating GitHub Copilot Agent into apps and services

Cybersecurity AI (CAI), the framework for AI Security

Containers for machine learning

Swap GPT for any LLM by changing a single line of code. Xinference lets you run open-source, speech, and multimodal models on cloud, on-prem, or your laptop — all through one unified, production-ready inference API.

AutoML library for deep learning

Deeplake is AI Data Runtime for Agents. It provides serverless postgres with a multimodal datalake, enabling scalable retrieval and training.

Kimi Code CLI is your next CLI agent.

KAG is a logical form-guided reasoning and retrieval framework based on OpenSPG engine and LLMs. It is used to build logical reasoning and factual Q&A solutions for professional domain knowledge bases. It can effectively overcome the shortcomings of the traditional RAG vector similarity calculation model.

🧙 Build, run, and manage data pipelines for integrating and transforming data.

The easiest way to serve AI apps and models - Build Model Inference APIs, Job queues, LLM apps, Multi-model pipelines, and more!

Apache Beam is a unified programming model for Batch and Streaming data processing.

Out-of-Core hybrid Apache Arrow/NumPy DataFrame for Python, ML, visualization and exploration of big tabular data at a billion rows per second 🚀

PraisonAI 🦞 — Hire a 24/7 AI Workforce. Stop writing boilerplate and start shipping autonomous self-improving agents that research, plan, code, and execute tasks. Deployed in 5 lines of code with built-in memory, RAG, and support for 100+ LLMs.

AI Toolkit for Healthcare Imaging

the LLM vulnerability scanner

Accessible large language models via k-bit quantization for PyTorch.

LMDeploy is a toolkit for compressing, deploying, and serving LLMs.

Build autonomous AI agents in Python.

A vector search SQLite extension that runs anywhere!

Stanford NLP Python library for tokenization, sentence segmentation, NER, and parsing of many human languages

OpenShell is the safe, private runtime for autonomous AI agents.

Evidently is ​​an open-source ML and LLM observability framework. Evaluate, test, and monitor any AI-powered system or data pipeline. From tabular data to Gen AI. 100+ metrics.

An open source python library for automated feature engineering

Utilities intended for use with Llama models.