Search every repository hiding inside awesome lists.

The fastest path to AI-powered full stack observability, even for lean teams.

🪢 Open source LLM engineering platform: LLM Observability, metrics, evals, prompt management, playground, datasets. Integrates with OpenTelemetry, Langchain, OpenAI SDK, LiteLLM, and more. 🍊YC W23

The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, and optimize production-quality AI applications while controlling costs and managing access to models and data.

Prefect is a workflow orchestration framework for building resilient data pipelines in Python.

VictoriaMetrics: fast, cost-effective monitoring solution and time series database

Highly available Prometheus setup with long term storage capabilities. A CNCF Incubating project.

Resolve production issues, fast. An open source observability platform unifying session replays, logs, metrics, traces and errors powered by ClickHouse and OpenTelemetry.

AI Agent Engineering Platform built on an Open Source TypeScript AI Agent Framework

highlight.io: The open source, full-stack monitoring platform. Error monitoring, session replay, logging, distributed tracing, and more.

An AI-powered next-generation open source real-time observability system.

Open-source observability for your GenAI or LLM application, based on OpenTelemetry

See where your AI coding tokens go. Interactive TUI dashboard for Claude Code, Codex, and Cursor cost observability.

Complete open-source monitoring and observability platform.

Ship AI Agents to Google Cloud in minutes, not months. Production-ready templates with built-in CI/CD, evaluation, and observability.

Next-generation AI Agent Optimization Platform: Cozeloop addresses challenges in AI agent development by providing full-lifecycle management capabilities from development, debugging, and evaluation to monitoring.

Enterprise-ready, Git native feature management solution

AI observability platform for production LLM and agent systems.

Open source APM: OpenTelemetry traces, metrics, and logs

The open-source LLMOps platform: prompt playground, prompt management, LLM evaluation, and LLM observability all in one place.

An AI Gateway, registry, and proxy that sits in front of any MCP, A2A, or REST/gRPC APIs, exposing a unified endpoint with centralized discovery, guardrails and management. Optimizes Agent & Tool calling, and supports plugins.

The missing DevTools for Claude Code — inspect session logs, tool calls, token usage, subagents, and context window in a visual UI. Free, open source.

The platform for LLM evaluations and AI agent testing

🕹️ Open-source, developer-first LLMOps platform designed to streamline prompt design, version management, instant delivery, collaboration, troubleshooting, observability and more.

Laminar - open-source observability platform purpose-built for AI agents. YC S24.

Open source platform for AI Engineering: OpenTelemetry-native LLM Observability, GPU Monitoring, Guardrails, Evaluations, Prompt Management, Vault, Playground. 🚀💻 Integrates with 50+ LLM Providers, VectorDBs, Agent Frameworks and GPUs.

Easy token price estimates for 400+ LLMs. TokenOps.

Simple. Scalable. Multi-cloud monitoring.

Open-source, end-to-end platform for evaluating, observing, and improving LLM and AI agent applications. Tracing · Evals · Simulations · Datasets · Gateway · Guardrails. Self-hostable. Apache 2.0.

ML powered analytics engine for outlier detection and root cause analysis.

Kuvasz (pronounce as [ˈkuvɒs]) is an open-source uptime and SSL monitoring service, with multiple notification channels, status pages, IAC support via YAML, Prometheus integration, a complete REST API and many more!