Awesome Opensource Ai

ToolJet is the open-source foundation of ToolJet AI - the enterprise app generation platform for building internal tools, dashboard, business applications, workflows and AI agents 🚀

Workflow Engine for Kubernetes

Machine Learning Toolkit for Kubernetes

Build, Manage and Deploy AI/ML Systems

A Datacenter Scale Distributed Inference Serving Framework

Dynamic, resilient AI orchestration. Coordinate data, models, and compute as you build AI workflows.

Standardized Distributed Generative and Predictive AI Inference Platform for Scalable, Multi-Framework Deployment on Kubernetes

An MLOps framework to package, deploy, monitor and manage thousands of production machine learning models

Machine Learning Pipelines for Kubeflow

An AI Gateway, registry, and proxy that sits in front of any MCP, A2A, or REST/gRPC APIs, exposing a unified endpoint with centralized discovery, guardrails and management. Optimizes Agent & Tool calling, and supports plugins.

Heterogeneous GPU Sharing on Kubernetes

Next Generation Agentic Proxy for AI Agents and MCP servers

Achieve state of the art inference performance with modern accelerators on Kubernetes

AI Infra / AI Orchestration / AI Control Plane

Kubernetes-native Job Queueing

Vendor-agnostic orchestration for training, inference and agentic workloads across NVIDIA, AMD, TPU, and Tenstorrent on clouds, Kubernetes, and bare metal.

Manages Unified Access to Generative AI Services built on Envoy Gateway

Automated Machine Learning on Kubernetes

MLRun is an open source MLOps platform for quickly building and managing continuous ML applications across their lifecycle. MLRun integrates into your development and CI/CD environment and automates the delivery of production data, ML pipelines, and online applications.

An open source DevOps tool from the CNCF for packaging and versioning AI/ML models, datasets, code, and configuration into an OCI Artifact.

Apache YuniKorn Core