Awesome Opensource Ai

The open source codebase powering HuggingChat

Official inference library for Mistral models

AI Agent Engineering Platform built on an Open Source TypeScript AI Agent Framework

An Open-Source Asynchronous Coding Agent

All-in-one LLM CLI tool featuring Shell Assistant, Chat-REPL, RAG, AI Tools & Agents, with access to OpenAI, Claude, Gemini, Ollama, Groq, and more.

Build, Manage and Deploy AI/ML Systems

High-speed Large Language Model Serving for Local Deployment

Cybersecurity AI (CAI), the framework for AI Security

Swap GPT for any LLM by changing a single line of code. Xinference lets you run open-source, speech, and multimodal models on cloud, on-prem, or your laptop — all through one unified, production-ready inference API.

Deeplake is AI Data Runtime for Agents. It provides serverless postgres with a multimodal datalake, enabling scalable retrieval and training.

The easiest way to serve AI apps and models - Build Model Inference APIs, Job queues, LLM apps, Multi-model pipelines, and more!

Build effective agents using Model Context Protocol and simple workflow patterns

Accessible large language models via k-bit quantization for PyTorch.

⚙️🦀 Build modular and scalable LLM Applications in Rust

LMDeploy is a toolkit for compressing, deploying, and serving LLMs.

Evidently is ​​an open-source ML and LLM observability framework. Evaluate, test, and monitor any AI-powered system or data pipeline. From tabular data to Gen AI. 100+ metrics.

Fast, flexible LLM inference

Open-source observability for your GenAI or LLM application, based on OpenTelemetry

🔥 Open Source Browser API for AI Agents & Apps. Steel Browser is a batteries-included browser sandbox that lets you automate the web without worrying about infrastructure.

Adding guardrails to large language models.

Tools for merging pretrained large language models.

OpenCompass is an LLM evaluation platform, supporting a wide range of models (Llama3, Mistral, InternLM2,GPT-4,LLaMa2, Qwen,GLM, Claude, etc) over 100+ datasets.

Dynamic, resilient AI orchestration. Coordinate data, models, and compute as you build AI workflows.

Data processing for and with foundation models! 🍎 🍋 🌽 ➡️ ➡️🍸 🍹 🍷

✨ AI Coding, Vim Style

TypeScript AI agent orchestration framework with dynamic workflows. Describe the goal, not the graph: a coordinator plans the task DAG at runtime and runs it on any LLM (Claude, ChatGPT, Gemini, DeepSeek, or local models).

Superagent protects your AI applications against prompt injections, data leaks, and harmful outputs. Embed safety directly into your app and prove compliance to your customers.

Julep — durable, composable AI agents. Flows that crash and resume, retry safely, and explain every step.

Open-source framework for building AI-powered apps in JavaScript, Go, and Python, built and used in production by Google

an ambient intelligence library

🧊 Open source LLM observability platform. One line of code to monitor, evaluate, and experiment. YC W23 🍓

Mooncake is the serving platform for Kimi, a leading LLM service provided by Moonshot AI.

A model-driven approach to building AI agents in just a few lines of code.

Python SDK for AI agent monitoring, LLM cost tracking, benchmarking, and more. Integrates with most LLMs and agent frameworks including CrewAI, Agno, OpenAI Agents SDK, Langchain, Autogen, AG2, and CamelAI

🐢 Open-Source Evaluation & Testing library for LLM Agents

A Low-Code MCP Framework for Building Complex and Innovative RAG Pipelines

Chronos: Pretrained Models for Time Series Forecasting

Robust recipes to align language models with human and AI preferences

⚡️next-generation personal AI assistant powered by LLM, RAG and agent loops, supporting computer-use, browser-use and coding agent, demo: https://demo.openagentai.org

ZenML 🙏: One AI Platform from Pipelines to Agents. https://zenml.io.

A GPU cluster manager for high-performance AI model serving (vLLM, SGLang) and on-demand SSH-accessible GPU instances.

H2O LLM Studio - a framework and no-code GUI for fine-tuning LLMs. Documentation: https://docs.h2o.ai/h2o-llmstudio/

A Next-Generation Training Engine Built for Ultra-Large MoE Models

Argilla is a collaboration tool for AI engineers and domain experts to build high-quality datasets

A blazing fast inference solution for text embeddings models

AutoRAG: Now your agent can find anything in your computer. It gets smarter if you are using it frequently.

A fast multimodal LLM for real-time voice

LLM training code for Databricks foundation models

Your agent in your terminal, equipped with local tools: writes code, uses the terminal, browses the web. Make your own persistent autonomous agent on top!

A full-stack AI Red Teaming platform securing AI ecosystems via OpenClaw Security Scan, Agent Scan, Skills Scan, MCP scan, AI Infra scan and LLM jailbreak evaluation.