Awesome Opensource Ai

🦜💬 Web app for interacting with any LangGraph agent (PY & TS) via a chat interface.

RamaLama is an open-source developer tool that simplifies the local serving of AI models from any source and facilitates their use for inference in production, all through the familiar language of containers.

Deepnote is a drop-in replacement for Jupyter with an AI-first design, sleek UI, new blocks, and native data integrations. Use Python, R, and SQL locally in your favorite IDE, then scale to Deepnote cloud for real-time collaboration, Deepnote agent, and deployable data apps. https://deepnote.com/

llama.cpp fork with additional SOTA quants and improved performance

Holistic Evaluation of Language Models (HELM) is an open source Python framework created by the Center for Research on Foundation Models (CRFM) at Stanford for holistic, reproducible and transparent evaluation of foundation models, including large language models (LLMs) and multimodal models.

Stateful agents that are like people, with memory, identity, and the ability to learn and adapt

The pretty much "official" DSPy framework for Typescript

Ruler — apply the same rules to all coding agents

pingcap/autoflow is a Graph RAG based and conversational knowledge base tool built with TiDB Serverless Vector Storage. Demo: https://tidb.ai

Kubernetes-native Job Queueing

Open source platform for AI Engineering: OpenTelemetry-native LLM Observability, GPU Monitoring, Guardrails, Evaluations, Prompt Management, Vault, Playground. 🚀💻 Integrates with 50+ LLM Providers, VectorDBs, Agent Frameworks and GPUs.

Maid is a free and open source application for interfacing with llama.cpp models locally, and with Anthropic, DeepSeek, Ollama, Mistral and OpenAI models remotely.

Apache Hamilton helps data scientists and engineers define testable, modular, self-documenting dataflows, that encode lineage/tracing and metadata. Runs and scales everywhere python does.

An Open Standard for lineage metadata collection

Build applications that make decisions (chatbots, agents, simulations, etc...). Monitor, trace, persist, and execute on your own infrastructure.

Inspect: A framework for large language model evaluations

Python & JS/TS SDK for running AI-generated code/code interpreting in your AI app

Bionic is an on-premise replacement for ChatGPT, offering the advantages of Generative AI while maintaining strict data confidentiality

Fully open data curation for reasoning models

Collect, aggregate, and visualize a data ecosystem's metadata

An open coding agent for your terminal, built by a community collective rather than a company. Bring your own model, keep your code on your machine, and owe nothing to anyone.

An AI-powered agentic red team framework that automates offensive security operations, from reconnaissance to exploitation to post-exploitation, with zero human intervention.

Vendor-agnostic orchestration for training, inference and agentic workloads across NVIDIA, AMD, TPU, and Tenstorrent on clouds, Kubernetes, and bare metal.

Fractal Graph-of-Thought. Rhizomatic Mind-Mapping for Ai-Agents, Web-Links, Notes, and Code.

DeepTeam is a framework to red team LLMs and AI agents.

The leading open-source AI copilot for JetBrains. Connect to any model in any environment, and customize your coding experience in any way you like.

Manages Unified Access to Generative AI Services built on Envoy Gateway

Official, AWS-supported MCP servers, skills, and plugins to help AI agents build on AWS

Responsible AI Toolbox is a suite of tools providing model and data exploration and assessment user interfaces and libraries that enable a better understanding of AI systems. These interfaces and libraries empower developers and stakeholders of AI systems to develop and monitor AI more responsibly, and take better data-driven actions.

Dive is an open-source MCP Host Desktop Application that seamlessly integrates with any LLMs supporting function calling capabilities. ✨

Code Editor for the AI Agents Era. Run multiple Claude Code and Codex agents across projects on your machine.

Fast, Flexible and Portable Structured Generation

JVector: the most advanced embedded vector search engine

OpenMLDB is an open-source machine learning database that provides a feature platform computing consistent features for training and inference.

Automated Machine Learning on Kubernetes

Machine learning with dataframes

MLE-bench is a benchmark for measuring how well AI agents perform at machine learning engineering

The LLM Anti-Framework

KaibanJS is a JavaScript-native framework for building and managing multi-agent systems with a Kanban-inspired approach.

You're the boss, agents are your team. They handle tasks on their own, message each other, and review each other's work. You just watch the kanban board and give high-level commands. Codex/Claude/OpenCode(200+ models, 75+ LLM providers, free models no auth). Build your AI company with multiple teams.

Interface for OuteTTS models.

Open-source, end-to-end platform for evaluating, observing, and improving LLM and AI agent applications. Tracing · Evals · Simulations · Datasets · Gateway · Guardrails. Self-hostable. Apache 2.0.

The open document intelligence platform for builders and hackers - DMS for the agentic world

An open source DevOps tool from the CNCF for packaging and versioning AI/ML models, datasets, code, and configuration into an OCI Artifact.

Ground truth layer for humans and AI agents working together. Version control for knowledge.

Platform for AI-powered software engineers

RTP-LLM: Alibaba's high-performance LLM inference engine for diverse applications.

Agent File (.af): An open file format for serializing stateful AI agents with persistent memory and behavior. Share, checkpoint, and version control agents across compatible frameworks.

Weave is a toolkit for developing AI-powered applications, built by Weights & Biases.

World's first fully integrated and fully Automated Kubernetes management and orchestration solution