Search awesome repositories

Open-source LLM/VLM load balancer and serving platform for self-hosting LLMs (and VLMs) at scale 🏓🦙 Alternative to projects like llm-d, Docker Model Runner, etc but with less moving parts and simple deployments built around ggml ecosystem. Runs on CPU and GPU.

Safe RLHF: Constrained Value Alignment via Safe Reinforcement Learning from Human Feedback

ExtractThinker is a Document Intelligence library for LLMs, offering ORM-style interaction for flexible and powerful document workflows.

τ-Bench: A Benchmark for Tool-Agent-User Interaction in Real-World Domains

"Your Fully-Automated Personal AI Assistant"

Fast Multimodal LLM on Mobile Devices

A Go framework for building production agent systems with graph workflows, tools, memory, A2A, AG-UI, MCP, evaluation, and observability.

Proma brings a seamless general-purpose Agent experience to your workflow. Built for 100× professionals and the proactive Agent era, it supports Claude and Pi runtimes, Feishu group chats, and any LLM provider.

The LLM Anti-Framework

Your autonomous engineering team in a CLI. Point Zeroshot at an issue, walk away, and return to production-grade code. Supports Claude Code, OpenAI Codex, OpenCode, and Gemini CLI.

Korea Investment & Securities Open API Github

Knowledge is a tool for saving, searching, accessing, exploring and chatting with all of your favorite websites, documents and files.

You're the boss, agents are your team. They handle tasks on their own, message each other, and review each other's work. You just watch the kanban board and give high-level commands. Codex/Claude/OpenCode(200+ models, 75+ LLM providers, free models no auth). Build your AI company with multiple teams.

E2B Desktop Sandbox for LLMs. E2B Sandbox with desktop graphical environment that you can connect to any LLM for secure computer use.

LLM powered fuzzing via OSS-Fuzz.

Custom AI agent platform to speed up your work.

Semantica • Build AI systems that can explain, trace, and justify every decision. Knowledge graphs, context graphs, reasoning engines, provenance, and governance for production AI.

ReSearch: Learning to Reason with Search for LLMs via Reinforcement Learning & ReCall: Learning to Reason with Tool Call for LLMs via Reinforcement Learning

AIlice is a fully autonomous, general-purpose AI agent.

Open-source, end-to-end platform for evaluating, observing, and improving LLM and AI agent applications. Tracing · Evals · Simulations · Datasets · Gateway · Guardrails. Self-hostable. Apache 2.0.

llama.go is like llama.cpp in pure Golang!

A modular and comprehensive solution to deploy a Multi-LLM and Multi-RAG powered chatbot (Amazon Bedrock, Anthropic, HuggingFace, OpenAI, Meta, AI21, Cohere, Mistral) using AWS CDK on AWS

The open document intelligence platform for builders and hackers - DMS for the agentic world

AutoPR autonomously wrote pull requests in response to issues

Examples of using E2B

The agent framework where every run is durable, replayable, and resumable by default.

AIDE: AI-Driven Exploration in the Space of Code. The machine Learning engineering agent that automates AI R&D.

Ground truth layer for humans and AI agents working together. Version control for knowledge.

✨ AI-powered markdown editor - leverage LLMs with your documents - 100% local or in the cloud

🦜️🔗LangChain for Rust, the easiest way to write LLM-based programs in Rust