Awesome Opensource Ai

A high-throughput and memory-efficient inference and serving engine for LLMs

Open Data Platform for analysts, quants and AI agents.

A Simple and Universal Swarm Intelligence Engine, Predicting Anything. 简洁通用的群体智能引擎，预测万物

Clone a voice in 5 seconds to generate arbitrary speech in real-time

LlamaIndex is the leading document agent and OCR platform

aider is AI pair programming in your terminal

DSPy: The framework for programming—not prompting—language models

In-depth tutorials on LLMs, RAGs and real-world AI agent applications.

A modular graph-based Retrieval-Augmented Generation (RAG) system

The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, and optimize production-quality AI applications while controlling costs and managing access to models and data.

A powerful MCP toolkit for coding, providing semantic retrieval and editing capabilities - the IDE for your agent

Hindsight: Agent Memory That Learns

FinGPT: Open-Source Financial Large Language Models! Revolutionize 🔥 We release the trained model on HuggingFace.

Luigi is a Python module that helps you build complex pipelines of batch jobs. It handles dependency resolution, workflow management, visualization etc. It also comes with Hadoop support built in.

Open-source NotebookLM alternative. Research the open web with live data(Reddit, YT, IG, TikTok, Indeed, Google Search, Maps etc) through one platform, API or MCP server. Join our Discord: https://discord.gg/ejRNvftDp9

TensorRT LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and supports state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. TensorRT LLM also contains components to create Python and C++ runtimes that orchestrate the inference execution in a performant way.

Open Machine Learning Compiler Framework

The Context Platform for your Data and AI Stack

Retrieval and Retrieval-augmented LLMs

TensorZero is an open-source LLMOps platform that unifies an LLM gateway, observability, evaluation, optimization, and experimentation.

Open source annotation tool for machine learning practitioners.

Amphion (/æmˈfaɪən/) is a toolkit for Audio, Music, and Speech Generation. Its purpose is to support reproducible research and help junior researchers and engineers get started in the field of audio, music, and speech generation research and development.

🧙 Build, run, and manage data pipelines for integrating and transforming data.

The easiest way to serve AI apps and models - Build Model Inference APIs, Job queues, LLM apps, Multi-model pipelines, and more!

An Extensible Toolkit for Finetuning and Inference of Large Foundation Models. Large Models for All.

Fit interpretable models. Explain blackbox machine learning.

NeMo Guardrails is an open-source toolkit for easily adding programmable guardrails to LLM-based conversational systems.

the portable Python dataframe library

Open-source scientific and technical publishing system built on Pandoc.

H2O LLM Studio - a framework and no-code GUI for fine-tuning LLMs. Documentation: https://docs.h2o.ai/h2o-llmstudio/

Argilla is a collaboration tool for AI engineers and domain experts to build high-quality datasets

Ecommerce Search and Discovery - marqo.ai

An AI Gateway, registry, and proxy that sits in front of any MCP, A2A, or REST/gRPC APIs, exposing a unified endpoint with centralized discovery, guardrails and management. Optimizes Agent & Tool calling, and supports plugins.

Machine Learning Pipelines for Kubeflow

Deepchecks: Tests for Continuous Validation of ML Models & Data. Deepchecks is a holistic open-source solution for all of your AI & ML validation needs, enabling to thoroughly test your data and models from research to production.

Superfast AI decision making and intelligent processing of multi-modal data.

Fast, Accurate, Lightweight Python library to make State of the Art Embedding

Python & JS/TS SDK for running AI-generated code/code interpreting in your AI app

TFX is an end-to-end platform for deploying production ML pipelines

Developer Asset Hub for NVIDIA Nemotron — A one-stop resource for training recipes, usage cookbooks, datasets, and full end-to-end reference examples to build with Nemotron models

Open-source, end-to-end platform for evaluating, observing, and improving LLM and AI agent applications. Tracing · Evals · Simulations · Datasets · Gateway · Guardrails. Self-hostable. Apache 2.0.

The open document intelligence platform for builders and hackers - DMS for the agentic world

Ground truth layer for humans and AI agents working together. Version control for knowledge.

No description.