Awesome Agent Harness

Secure, Fast, and Extensible Sandbox runtime for AI agents.

One portable memory layer for every AI agent: local-first, Markdown-native, user-owned, and self-evolving across apps, tools, and workflows.

Multi-Agent Harness for Production AI

🤗 ml-intern: an open-source ML engineer that reads papers, trains models, and ships ML models

Agent Reinforcement Trainer: train multi-step agents for real-world tasks using GRPO. Give your agents on-the-job training. Reinforcement learning for Qwen3.6, GPT-OSS, Llama, and more!

AI Observability & Evaluation

Open source MCP Servers for AWS

Cybersecurity AI (CAI), the framework for AI Security

PraisonAI 🦞 — Hire a 24/7 AI Workforce. Stop writing boilerplate and start shipping autonomous self-improving agents that research, plan, code, and execute tasks. Deployed in 5 lines of code with built-in memory, RAG, and support for 100+ LLMs.

OpenShell is the safe, private runtime for autonomous AI agents.

🧱 easy, fast and local-first microVM runtime

Plano is an AI-native proxy and data plane for agentic apps — with built-in orchestration, safety, observability, and smart LLM routing so you stay focused on your agents core logic.

Omnigent is an open-source AI agent framework and meta-harness: orchestrate Claude Code, Codex, Cursor, Pi, and custom agents — swap harnesses without rewriting, enforce policies and sandboxing, and collaborate in real time from any device.

结合知识库、知识图谱管理的 多租户 Agent Harness 平台。 An agent harness that integrates a LightRAG knowledge base and knowledge graphs. Build with LangChain + Vue + FastAPI, support DeepAgents、MinerU PDF、Neo4j 、MCP.

🧊 Open source LLM observability platform. One line of code to monitor, evaluate, and experiment. YC W23 🍓

The 100 line AI agent that solves GitHub issues or helps you in your command line. Radically simple, no huge configs, no giant monorepo—but scores >74% on SWE-bench verified!

Python SDK for AI agent monitoring, LLM cost tracking, benchmarking, and more. Integrates with most LLMs and agent frameworks including CrewAI, Agno, OpenAI Agents SDK, Langchain, Autogen, AG2, and CamelAI

SWE-bench: Can Language Models Resolve Real-world Github Issues?

AI Agent Governance Toolkit — Policy enforcement, zero-trust identity, execution sandboxing, and reliability engineering for autonomous AI agents. Covers 10/10 OWASP Agentic Top 10.

Our library for RL environments + evals

Your agent in your terminal, equipped with local tools: writes code, uses the terminal, browses the web. Make your own persistent autonomous agent on top!

The open-source LLMOps platform: prompt playground, prompt management, LLM evaluation, and LLM observability all in one place.

An AI Gateway, registry, and proxy that sits in front of any MCP, A2A, or REST/gRPC APIs, exposing a unified endpoint with centralized discovery, guardrails and management. Optimizes Agent & Tool calling, and supports plugins.

Enterprise AI Platform with guardrails, MCP registry, gateway & orchestrator

Open-source security automation platform for teams and AI agents

LangChain 🔌 MCP

Agent Skills as a Memory Layer

AI-Driven Life Cycle (AI-DLC) adaptive workflow steering rules for AI coding agents

Devon: An open-source pair programmer

Evaluation and Tracking for LLM Experiments and AI Agents

The platform for LLM evaluations and AI agent testing

Cascading runtime for AI agents. Optimize cost, latency, quality, and policy decisions inside the agent loop.

Amazon Bedrock Agentcore accelerates AI agents into production with the scale, reliability, and security, critical to real-world deployment.

agent-sandbox enables easy management of isolated, stateful, singleton workloads, ideal for use cases like AI agent runtimes.

Security scanner for AI agents, MCP servers and agent skills.

The NVIDIA NeMo Agent toolkit is an open-source library for efficiently connecting and optimizing teams of AI agents.

A benchmark for LLMs on complicated tasks in the terminal

A production-oriented multi-agent orchestration framework.

How real engineers run Claude Code and Codex: spec-driven planning, enforced TDD, persistent memory, and quality enforcement on all levels. Make your agents production-ready.

τ-Bench: A Benchmark for Tool-Agent-User Interaction in Real-World Domains

Code repo for "WebArena: A Realistic Web Environment for Building Autonomous Agents"

E2B Desktop Sandbox for LLMs. E2B Sandbox with desktop graphical environment that you can connect to any LLM for secure computer use.

Open-source, end-to-end platform for evaluating, observing, and improving LLM and AI agent applications. Tracing · Evals · Simulations · Datasets · Gateway · Guardrails. Self-hostable. Apache 2.0.

Reference code for the Meta-Harness paper.

The Cloud Sandbox Built for AI Agents

OpenTelemetry Instrumentation for AI Observability

Evaluate and improve models and agents using environments

The Continuous-Improvement Stack for Agents. Our environment data and evals power agent improvement and monitoring.

ClawKeeper: Comprehensive Safety Protection for OpenClaw Agents Through Skills, Plugins, and Watchers (aka The Norton for OpenClaw)

Minimal and readable coding agent harness implementation in Python to explain the core components of coding agents.