Search awesome repositories

Test your prompts, agents, and RAGs. Red teaming/pentesting/vulnerability scanning for AI. Compare performance of GPT, Claude, Gemini, DeepSeek, and more. Simple declarative configs with command line and CI/CD integration. Used by OpenAI and Anthropic.

The official Python SDK for Model Context Protocol servers and clients

⌥ AI Coding agent for the terminal — hash-anchored edits, optimized tool harness, LSP, Python, browser, subagents, and more

AGENTS.md — a simple, open format for guiding coding agents

A configuration framework that enhances Claude Code with specialized commands, cognitive personas, and development methodologies.

The first open-source harness builder for AI coding. Make AI coding deterministic and repeatable.

A Go agent harness and service framework

Debug, evaluate, and monitor your LLM applications, RAG systems, and agentic workflows with comprehensive tracing, automated evaluations, and production-ready dashboards.

An open-source, code-first Python toolkit for building, evaluating, and deploying sophisticated AI agents with flexibility and control.

Scale computer-use 2.0 with open-source drivers, cross-OS fleets, and benchmarks for training, evaluation, and data generation.

SWE-agent takes a GitHub issue and tries to automatically fix it, using your LM of choice. It can also be employed for offensive cybersecurity or competitive coding challenges. [NeurIPS 2024]

Context window optimization for AI coding agents. Sandboxes tool output (98% reduction), persists session memory, and enforces routing across 17 platforms via MCP + hooks.

Devika is the first open-source implementation of an Agentic Software Engineer. Initially started as an open-source alternative to Devin.

AI Agent Framework, the Pydantic way

Hindsight: Agent Memory That Learns

Open source agentic operating system

Agent Skills for Google products and technologies

Build reliable customer-facing AI agents with Parlant: an interaction control harness optimized for controlled, consistent, and predictable LLM interactions.

Open-source Agent Operating System

The LLM Evaluation Framework

Gas Town - multi-agent workspace manager

A comprehensive collection of Agent Skills for context engineering, multi-agent architectures, and production agent systems. Use when building, optimizing, or debugging agent systems that require effective context management.

🐫 CAMEL: The first and the best multi-agent framework. Finding the Scaling Law of Agents. https://www.camel-ai.org

Browser Harness | Self-healing harness that enables LLMs to complete any task.

SkillOpt is a text-space optimizer that trains reusable natural-language skills for frozen LLM agents through trajectory-driven edits, validation-gated updates, and deployable best_skill.md artifacts.

MCP Toolbox for Databases is an open source MCP server for databases.

Python SDK for Agent AI Observability, Monitoring and Evaluation Framework. Includes features like agent, llm and tools tracing, debugging multi-agentic system, self-hosted dashboard and advanced analytics with timeline and execution graph view

"DeepCode: Open Agentic Coding (Paper2Code & Text2Web & Text2Backend)"

"OpenHarness: Open Agent Harness with a Built-in Personal Agent--Ohmo!"

Supercharge Your LLM Application Evaluations 🚀