Awesome Harness Engineering

The agent harness performance optimization system. Skills, instincts, memory, security, and research-first development for Claude Code, Codex, Opencode, Cursor and beyond.

Production-ready platform for agentic workflow development.

An open-source long-horizon SuperAgent harness that researches, codes, and creates. With the help of sandboxes, memories, tools, skill, subagents and message gateway, it handles different levels of tasks that could take minutes to hours.

Universal memory layer for AI Agents

A programming framework for agentic AI

Framework for orchestrating role-playing, autonomous AI agents. By fostering collaborative intelligence, CrewAI empowers agents to work together seamlessly, tackling complex tasks.

an open source, extensible AI agent that goes beyond code suggestions - install, execute, edit, and test with any LLM

A collection of notebooks/recipes showcasing some fun and effective ways of using Claude.

aider is AI pair programming in your terminal

"CLI-Anything: Making ALL Software Agent-Native" -- CLI-Hub: https://clianything.cc/

Build resilient agents.

Compress tool outputs, logs, files, and RAG chunks before they reach the LLM. 60-95% fewer tokens, same answers. Library, proxy, MCP server.

High-performance code intelligence MCP server. Indexes codebases into a persistent knowledge graph — average repo in milliseconds. 158 languages, sub-ms queries, 99% fewer tokens. Single static binary, zero dependencies.

Composio powers 1000+ toolkits, tool search, context management, authentication, and a sandboxed workbench to help you build AI agents that turn intent into action.

🤗 smolagents: a barebones library for agents that think in code.

Cognee is the open-source AI memory platform for agents. Give your AI agents persistent long-term memory across sessions with a self-hosted knowledge graph engine.

Self-evolving Context Database for AI Agents. Unify Agent Memory, Knowledge RAG and Skills.

The batteries-included agent harness.

Platform for stateful agents: AI with advanced memory that can learn and self-improve over time.

Test your prompts, agents, and RAGs. Red teaming/pentesting/vulnerability scanning for AI. Compare performance of GPT, Claude, Gemini, DeepSeek, and more. Simple declarative configs with command line and CI/CD integration. Used by OpenAI and Anthropic.

Debug, evaluate, and monitor your LLM applications, RAG systems, and agentic workflows with comprehensive tracing, automated evaluations, and production-ready dashboards.

An open-source, code-first Python toolkit for building, evaluating, and deploying sophisticated AI agents with flexibility and control.

SWE-agent takes a GitHub issue and tries to automatically fix it, using your LM of choice. It can also be employed for offensive cybersecurity or competitive coding challenges. [NeurIPS 2024]

Open-source infrastructure for Computer-Use Agents. Sandboxes, SDKs, and benchmarks to train and evaluate AI agents that can control full desktops (macOS, Linux, Windows).

AI Agent Framework, the Pydantic way

Hindsight: Agent Memory That Learns

A collection of projects designed to help developers quickly get started with building deployable applications using the Claude API

Browser Harness | Self-healing harness that enables LLMs to complete any task.

"OpenHarness: Open Agent Harness with a Built-in Personal Agent--Ohmo!"

Fully autonomous & self-evolving research from idea to paper. Chat an Idea. Get a Paper. 🦞

Open Source framework for voice and multimodal conversational AI

Open-source, secure environment with real-world tools for enterprise-grade agents.

IronClaw is an Agent OS focused on privacy, security and extensibility

SkillOpt is a text-space optimizer that trains reusable natural-language skills for frozen LLM agents through trajectory-driven edits, validation-gated updates, and deployable best_skill.md artifacts.

Multi-Agent Harness for Production AI

AI Observability & Evaluation

Build effective agents using Model Context Protocol and simple workflow patterns

Open-source observability for your GenAI or LLM application, based on OpenTelemetry

NeMo Guardrails is an open-source toolkit for easily adding programmable guardrails to LLM-based conversational systems.

Build an agent harness and control it end-to-end. Open-source SDK for production AI agents in Python & TypeScript - any model, any cloud.

[EMNLP'23, ACL'24] To speed up LLMs' inference and enhance LLM's perceive of key information, compress the prompt and KV-Cache, which achieves up to 20x compression with minimal performance loss.

The first "code-first" agent framework for seamlessly planning and executing data analytics tasks.

Omnigent is an open-source AI agent framework and meta-harness: orchestrate Claude Code, Codex, Cursor, Pi, and custom agents — swap harnesses without rewriting, enforce policies and sandboxing, and collaborate in real time from any device.

Python SDK for AI agent monitoring, LLM cost tracking, benchmarking, and more. Integrates with most LLMs and agent frameworks including CrewAI, Agno, OpenAI Agents SDK, Langchain, Autogen, AG2, and CamelAI

All-in-One Sandbox for AI Agents that combines Browser, Shell, File, MCP and VSCode Server in a single Docker container.

AI Agent Governance Toolkit — Policy enforcement, zero-trust identity, execution sandboxing, and reliability engineering for autonomous AI agents. Covers 10/10 OWASP Agentic Top 10.

Zep | Examples, Integrations, & More

autonomous harness engineering

AI observability platform for production LLM and agent systems.

Next Generation Agentic Proxy for AI Agents and MCP servers