Awesome Opensource Ai

Open-source evaluation toolkit of large multi-modality models (LMMs), support 220+ LMMs, 80+ benchmarks

One delightful Ruby framework for every major AI provider. Build AI agents, chatbots, RAG apps, and multimodal workflows in beautiful, expressive code.

Optimizing inference proxy for LLMs

LightLLM is a Python-based LLM (Large Language Model) inference and serving framework, notable for its lightweight design, easy scalability, and high-speed performance.

AdalFlow: The library to build & auto-optimize LLM applications.

Harness LLMs with Multi-Agent Programming

A system for agentic LLM-powered data processing and ETL

Achieve state of the art inference performance with modern accelerators on Kubernetes

OpenAgents - AI Agent Networks for Open Collaboration

Open-source security automation platform for teams and AI agents

A Comprehensive Benchmark to Evaluate LLMs as Agents (ICLR'24)

Personal AI Notebooks. Organize files & webpages and generate notes from them. Open source, local & open data, open model choice (incl. local).

II-Agent: a new open-source framework to build and deploy intelligent agents

Build production-ready AI agents in both Python and Typescript.

🕹️ Open-source, developer-first LLMOps platform designed to streamline prompt design, version management, instant delivery, collaboration, troubleshooting, observability and more.

The Security Toolkit for LLM Interactions

A streamlined and customizable framework for efficient large model (LLM, VLM, AIGC) evaluation and performance benchmarking.

Skywork-R1V is an advanced multimodal AI model series developed by Skywork AI, specializing in vision-language reasoning.

🦜💬 Web app for interacting with any LangGraph agent (PY & TS) via a chat interface.

Distributed LLM inference. Connect home devices into a powerful cluster to accelerate LLM inference. More devices means faster inference.

RamaLama is an open-source developer tool that simplifies the local serving of AI models from any source and facilitates their use for inference in production, all through the familiar language of containers.

Infinity is a high-throughput, low-latency serving engine for text-embeddings, reranking models, clip, clap and colpali

The pretty much "official" DSPy framework for Typescript

PentestAgent is an AI agent framework for black-box security testing, supporting bug bounty, red-team, and penetration testing workflows.

Multi-framework streaming Markdown renderers for AI apps: Vue/Nuxt, React/Next.js, Svelte, and Angular, with Mermaid, KaTeX, Shiki, Monaco, safe HTML, and low-jitter updates.

Templates and workflow for generating PRDs, Tech Designs, and MVP and more using LLMs for AI IDEs

Modular Python framework for AI agents and workflows with chain-of-thought reasoning, tools, and memory.

SDG is a specialized framework designed to generate high-quality structured tabular data.

Python & JS/TS SDK for running AI-generated code/code interpreting in your AI app

An open coding agent for your terminal, built by a community collective rather than a company. Bring your own model, keep your code on your machine, and owe nothing to anyone.

Research project. A Memory solution for users, teams, and applications.

Vim plugin for LLM-assisted code/text completion

The Agentic Framework of the PHP ecosystem to build production-ready AI driven applications. Connect components (LLMs, Tools, vector DBs, memory) to agents that interact with your data and UI.

You're the boss, agents are your team. They handle tasks on their own, message each other, and review each other's work. You just watch the kanban board and give high-level commands. Codex/Claude/OpenCode/Cursor/Grok/GitHub Copilot/Kiro/Z.AI/MiniMax/Kimi(200+ models, 75+ LLM providers, free models no auth). Build your AI company with multiple teams

Manages Unified Access to Generative AI Services built on Envoy Gateway

ContextGem: Effortless LLM extraction from documents

Synthetic data curation for post-training and structured data extraction

Automated Machine Learning on Kubernetes

A fast and lightweight framework for creating decentralized agents with ease.

Safe RLHF: Constrained Value Alignment via Safe Reinforcement Learning from Human Feedback

Fast Multimodal LLM on Mobile Devices

Open-source, end-to-end platform for evaluating, observing, and improving LLM and AI agent applications. Tracing · Evals · Simulations · Datasets · Gateway · Guardrails. Self-hostable. Apache 2.0.

The LLM Anti-Framework

The open document intelligence platform for builders and hackers - DMS for the agentic world

💃 Dance with Intelligence in Your Code. Minuet offers code completion as-you-type from popular LLMs including OpenAI, Gemini, Claude, Ollama, Llama.cpp, Codestral, and more.

Ground truth layer for humans and AI agents working together. Version control for knowledge.

🌎💪 BrowserGym, a Gym environment for web task automation

RTP-LLM: Alibaba's high-performance LLM inference engine for diverse applications.

🥤 RAGLite is a Python toolkit for Retrieval-Augmented Generation (RAG) with DuckDB or PostgreSQL

AI-powered code assistant for Vim. OpenAI and ChatGPT plugin for Vim and Neovim.