Awesome Agent Harness

Plano is an AI-native proxy and data plane for agentic apps — with built-in orchestration, safety, observability, and smart LLM routing so you stay focused on your agents core logic.

Demo of a customer service use case implemented with the OpenAI Agents SDK

Omnigent is an open-source AI agent framework and meta-harness: orchestrate Claude Code, Codex, Cursor, Pi, and custom agents — swap harnesses without rewriting, enforce policies and sandboxing, and collaborate in real time from any device.

结合知识库、知识图谱管理的 多租户 Agent Harness 平台。 An agent harness that integrates a LightRAG knowledge base and knowledge graphs. Build with LangChain + Vue + FastAPI, support DeepAgents、MinerU PDF、Neo4j 、MCP.

AIOS: AI Agent Operating System

🧊 Open source LLM observability platform. One line of code to monitor, evaluate, and experiment. YC W23 🍓

Python SDK for AI agent monitoring, LLM cost tracking, benchmarking, and more. Integrates with most LLMs and agent frameworks including CrewAI, Agno, OpenAI Agents SDK, Langchain, Autogen, AG2, and CamelAI

All-in-One Sandbox for AI Agents that combines Browser, Shell, File, MCP and VSCode Server in a single Docker container.

AI Agent Governance Toolkit — Policy enforcement, zero-trust identity, execution sandboxing, and reliability engineering for autonomous AI agents. Covers 10/10 OWASP Agentic Top 10.

Our library for RL environments + evals

Your agent in your terminal, equipped with local tools: writes code, uses the terminal, browses the web. Make your own persistent autonomous agent on top!

The open-source LLMOps platform: prompt playground, prompt management, LLM evaluation, and LLM observability all in one place.

An AI Gateway, registry, and proxy that sits in front of any MCP, A2A, or REST/gRPC APIs, exposing a unified endpoint with centralized discovery, guardrails and management. Optimizes Agent & Tool calling, and supports plugins.

A Comprehensive Benchmark to Evaluate LLMs as Agents (ICLR'24)

Devon: An open-source pair programmer

Evaluation and Tracking for LLM Experiments and AI Agents

Cascading runtime for AI agents. Optimize cost, latency, quality, and policy decisions inside the agent loop.

Amazon Bedrock Agentcore accelerates AI agents into production with the scale, reliability, and security, critical to real-world deployment.

AI Agent Builder and Runtime by Docker Engineering

Framework for evaluating and improving agents

agent-sandbox enables easy management of isolated, stateful, singleton workloads, ideal for use cases like AI agent runtimes.

A streamlined and customizable framework for efficient large model (LLM, VLM, AIGC) evaluation and performance benchmarking.

Agent harness to make your slop code well-engineered and beautiful.

Security scanner for AI agents, MCP servers and agent skills.

Skills, MCP servers, Custom Agents, Agents.md for SDKs to ground Coding Agents

Open source platform for AI Engineering: OpenTelemetry-native LLM Observability, GPU Monitoring, Guardrails, Evaluations, Prompt Management, Vault, Playground. 🚀💻 Integrates with 50+ LLM Providers, VectorDBs, Agent Frameworks and GPUs.

Build applications that make decisions (chatbots, agents, simulations, etc...). Monitor, trace, persist, and execute on your own infrastructure.

A benchmark for LLMs on complicated tasks in the terminal

One brain, many harnesses. Portable .agent/ folder (memory + skills + protocols) that plugs into Claude Code, Cursor, Windsurf, OpenCode, OpenClaw, Hermes, or DIY Python — and keeps its knowledge when you switch.

A production-oriented multi-agent orchestration framework.

Google's open source distributed agent runtime

No description.

Code repo for "WebArena: A Realistic Web Environment for Building Autonomous Agents"

Run Coding Agents in Sandboxes. Control Them Over HTTP. Supports Claude Code, Codex, OpenCode, and Amp.

LLM powered fuzzing via OSS-Fuzz.

Open-source, end-to-end platform for evaluating, observing, and improving LLM and AI agent applications. Tracing · Evals · Simulations · Datasets · Gateway · Guardrails. Self-hostable. Apache 2.0.

The Cloud Sandbox Built for AI Agents

OpenTelemetry Instrumentation for AI Observability

1 place to call all your agents - OpenCode, Hermes, Claude Managed Agents, Cursor Agents API, DeepAgents.

Evaluate and improve models and agents using environments

A production-ready runtime framework for agent apps with secure tool sandboxing, Agent-as-a-Service APIs, scalable deployment, full-stack observability, and broad framework compatibility.

Security Governance for Agentic AI

CheetahClaws: A Fast and Easy-to-Use Agent Harness Infrastructure for Long-Horizon, Multi-Model, and Tool-Using AI Systems

An agent benchmark with tasks in a simulated software company.

Claw-Eval is an evaluation harness for evaluating LLM as agents. All tasks verified by humans.

Collection of evals for Inspect AI

Bring your own agent and build a self-improving agentic system. Automatically mine failures, optimize the agent harness, and gate against regressions.

The open agent control plane. Govern autonomous AI agents with pre-execution policy enforcement, approval gates, and audit trails. Works with LangChain, CrewAI, MCP, and any framework.

SWE-Bench Pro: Can AI Agents Solve Long-Horizon Software Engineering Tasks?

An in-the-wild benchmark for AI agents in the OpenClaw Environment.