Awesome Opensource Ai

A streamlined and customizable framework for efficient large model (LLM, VLM, AIGC) evaluation and performance benchmarking.

RAG Web UI is an intelligent dialogue system based on RAG (Retrieval-Augmented Generation) technology.

A framework for prompt tuning using Intent-based Prompt Calibration

Apache Hamilton helps data scientists and engineers define testable, modular, self-documenting dataflows, that encode lineage/tracing and metadata. Runs and scales everywhere python does.

An AI-powered agentic red team framework that automates offensive security operations, from reconnaissance to exploitation to post-exploitation, with zero human intervention.

Developer Asset Hub for NVIDIA Nemotron — A one-stop resource for training recipes, usage cookbooks, datasets, and full end-to-end reference examples to build with Nemotron models

Synthetic data curation for post-training and structured data extraction

MLE-bench is a benchmark for measuring how well AI agents perform at machine learning engineering

A fast and lightweight framework for creating decentralized agents with ease.

Reference implementations of MLPerf® inference benchmarks

Open-source, end-to-end platform for evaluating, observing, and improving LLM and AI agent applications. Tracing · Evals · Simulations · Datasets · Gateway · Guardrails. Self-hostable. Apache 2.0.

Readymade evaluators for your LLM apps