Awesome Opensource Ai

Python SDK for AI agent monitoring, LLM cost tracking, benchmarking, and more. Integrates with most LLMs and agent frameworks including CrewAI, Agno, OpenAI Agents SDK, Langchain, Autogen, AG2, and CamelAI

Model interpretability and understanding for PyTorch

A Low-Code MCP Framework for Building Complex and Innovative RAG Pipelines

⚡ Pure-Rust WebGPU inference engine — OpenAI-API compatible, GGUF native, runs on any GPU. No Python. No llama.cpp. Single binary.

HelixDB is an OLTP graph-vector database built in Rust on Object Storage.

lakeFS - Data version control for your data lake | Git for data

⚡️next-generation personal AI assistant powered by LLM, RAG and agent loops, supporting computer-use, browser-use and coding agent, demo: https://demo.openagentai.org

Simple and Distributed Machine Learning

Probabilistic time series modeling in Python

Visualizer for pandas data structures

The CLI and skills that turn any coding assistant into an expert at creating, evaluating, and deploying AI agents on Google Cloud.

Argilla is a collaboration tool for AI engineers and domain experts to build high-quality datasets

Reliable model swapping for any local OpenAI/Anthropic compatible server - llama.cpp, vllm, etc

H2O LLM Studio - a framework and no-code GUI for fine-tuning LLMs. Documentation: https://docs.h2o.ai/h2o-llmstudio/

Peekaboo is a macOS CLI & optional MCP server that enables AI agents to capture screenshots of applications, or the entire system, with optional visual question answering through local or remote AI models.

AI Agent Governance Toolkit — Policy enforcement, zero-trust identity, execution sandboxing, and reliability engineering for autonomous AI agents. Covers 10/10 OWASP Agentic Top 10.

Amundsen is a metadata driven application for improving the productivity of data analysts, data scientists and engineers when interacting with data.

Prompt Engineering | Prompt Versioning | Use GPT or other prompt based models to get structured output. Join our discord for Prompt-Engineering, LLMs and other latest research

The AI-native database built for LLM applications, providing incredibly fast hybrid search of dense vector, sparse vector, tensor (multi-vector), and full-text.

Reliable Multi-Agent Orchestration Framework

Latitude is the open-source ai monitoring platform.

Local-first session search, analytics, insights, and token use statistics for coding agents, supporting Claude Code, Codex, and more than 20 other agents.

A fast library for AutoML and tuning. Join our Discord: https://discord.gg/Cppx2vSPVP.

Your agent in your terminal, equipped with local tools: writes code, uses the terminal, browses the web. Make your own persistent autonomous agent on top!

One-for-All Multimodal Evaluation Toolkit Across Text, Image, Video, and Audio Tasks

The open-source LLMOps platform: prompt playground, prompt management, LLM evaluation, and LLM observability all in one place.

Set of tools to assess and improve LLM security.

Machine Learning Pipelines for Kubeflow

A nearly-live implementation of OpenAI's Whisper.

The Python Risk Identification Tool for generative AI (PyRIT) is an open source framework built to empower security professionals and engineers to proactively identify risks in generative AI systems.

TorchGeo: datasets, samplers, transforms, and pre-trained models for geospatial data

An AI Gateway, registry, and proxy that sits in front of any MCP, A2A, or REST/gRPC APIs, exposing a unified endpoint with centralized discovery, guardrails and management. Optimizes Agent & Tool calling, and supports plugins.

OpenAgents - AI Agent Networks for Open Collaboration

A system for agentic LLM-powered data processing and ETL

Next Generation Agentic Proxy for AI Agents and MCP servers

This is a Phi Family of SLMs book for getting started with Phi Models. Phi a family of open sourced AI models developed by Microsoft. Phi models are the most capable and cost-effective small language models (SLMs) available, outperforming models of the same size and next size up across a variety of language, reasoning, coding, and math benchmarks

Fully customizable AI chatbot component for your website

Open-source multimodal retrieval engine (Morphik Core). By Morphik — AI back office for skilled nursing & senior living (morphik.ai).

AI Agent that handles engineering tasks end-to-end: integrates with developers’ tools, plans, executes, and iterates until it achieves a successful result.

Personal AI Notebooks. Organize files & webpages and generate notes from them. Open source, local & open data, open model choice (incl. local).

Evaluation and Tracking for LLM Experiments and AI Agents

II-Agent: a new open-source framework to build and deploy intelligent agents

Build production-ready AI agents in both Python and Typescript.

🕹️ Open-source, developer-first LLMOps platform designed to streamline prompt design, version management, instant delivery, collaboration, troubleshooting, observability and more.

Scalable and efficient data transformation framework - backwards compatible with dbt.

Framework for evaluating and improving agents

(Crystal is now Nimbalyst) Run multiple Codex and Claude Code AI sessions in parallel git worktrees. Test, compare approaches & manage AI-assisted development workflows in one desktop app.

A streamlined and customizable framework for efficient large model (LLM, VLM, AIGC) evaluation and performance benchmarking.

RAG Web UI is an intelligent dialogue system based on RAG (Retrieval-Augmented Generation) technology.

An open-source visual programming environment for battle-testing prompts to LLMs.