Awesome Opensource Ai

Open Source Computer Vision Library

Apache Spark - A unified analytics engine for large-scale data processing

Ray is an AI compute engine. Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads.

Scalable, Portable and Distributed Gradient Boosting (GBDT, GBRT or GBM) Library, for Python, R, Java, Scala, C and more. Runs on single machine, Hadoop, Spark, Dask, Flink and DataFlow

The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, and optimize production-quality AI applications while controlling costs and managing access to models and data.

A powerful MCP toolkit for coding, providing semantic retrieval and editing capabilities - the IDE for your agent

An open-source AI coding agent that lives in your terminal.

Apache Flink

Debug, evaluate, and monitor your LLM applications, RAG systems, and agentic workflows with comprehensive tracing, automated evaluations, and production-ready dashboards.

ONNX Runtime: cross-platform, high performance ML inferencing and training accelerator

Workflow Engine for Kubernetes

Qwen3-Coder is the code version of Qwen3, the large language model series developed by Qwen team.

MNN: A blazing-fast, lightweight inference engine battle-tested by Alibaba, powering high-performance on-device LLMs and Edge AI.

The Open Context Layer for Data and AI , OpenMetadata is the open platform for building trusted data context and business semantics for humans, AI assistants, and agents.

Open Machine Learning Compiler Framework

LangChain4j is an idiomatic, open-source Java library for building LLM-powered applications on the JVM. It offers a unified API over popular LLM providers and vector stores, and makes implementing tool calling (including MCP support), agents and RAG easy. It integrates seamlessly with enterprise Java frameworks like Quarkus and Spring Boot.

OpenRefine is a free, open source power tool for working with messy data and improving it

Developer-friendly OSS embedded retrieval library for multimodal AI. Search More; Manage Less.

Multi-platform SDK for integrating GitHub Copilot Agent into apps and services

cuDF - GPU DataFrame Library

An Application Framework for AI Engineering

A fast, scalable, high performance Gradient Boosting on Decision Trees library, used for ranking, classification, regression and other machine learning tasks for Python, R, Java, C++. Supports computation on CPU and GPU.

An open-source storage framework that enables building a Lakehouse architecture with compute engines including Spark, PrestoDB, Flink, Trino, and Hive and APIs

The Open Source Feature Store for AI/ML

Upserts, Deletes And Incremental Processing on Big Data.

lakeFS - Data version control for your data lake | Git for data

The CLI and skills that turn any coding assistant into an expert at creating, evaluating, and deploying AI agents on Google Cloud.

Ecommerce Search and Discovery - marqo.ai

An Engine-Agnostic Deep Learning Framework in Java

Agent framework for the JVM. Pronounced Em-BAY-bel /ɛmˈbeɪbəl/

Fully customizable AI chatbot component for your website

Deequ is a library built on top of Apache Spark for defining "unit tests for data", which measure data quality in large datasets.

Non-Metric Space Library (NMSLIB): An efficient similarity search library and a toolkit for evaluation of k-NN methods for generic non-metric spaces.

The pretty much "official" DSPy framework for Typescript

A comprehensive set of fairness metrics for datasets and machine learning models, explanations for these metrics, and algorithms to mitigate bias in datasets and models.

JVector: the most advanced embedded vector search engine

OpenMLDB is an open-source machine learning database that provides a feature platform computing consistent features for training and inference.

🛰️ An approximate nearest-neighbor search library for Python and Java with a focus on ease of use, simplicity, and deployability.

RTP-LLM: Alibaba's high-performance LLM inference engine for diverse applications.