Open highlighted repo slot
Put your repository first
Promote a GitHub repo at the top of Awesome repository list views for 7 days.
Awesome List
A curated list of awesome LLM frameworks, libraries and software.
GitHub stars and default-branch commits for uhub/awesome-llm.
Open highlighted repo slot
Promote a GitHub repo at the top of Awesome repository list views for 7 days.
Convert any URL to an LLM-friendly input with a simple prefix https://r.jina.ai/
Low-code framework for building custom LLMs, neural networks, and other AI models
TensorZero is an open-source LLMOps platform that unifies an LLM gateway, observability, evaluation, optimization, and experimentation.
The best way to get AI coding agents to solve hard problems in complex codebases.
Build high-quality LLM apps - from prototyping, testing to production deployment and monitoring.
Bytebot is a self-hosted AI desktop agent that automates computer tasks through natural language commands, operating within a containerized Linux desktop environment.
LMCache: Supercharge Your LLM with the Fastest KV Cache Layer
A self-hosted, offline, ChatGPT-like chatbot. Powered by Llama 2. 100% private, with no data leaving your device. New: Code Llama support!
The open source codebase powering HuggingChat
Official inference library for Mistral models
Self-evolving memory OS for LLM & AI Agents: ultra-persistent memory, hybrid-retrieval, and cross-task skill reuse, with 35.24% token savings
AI Agent Engineering Platform built on an Open Source TypeScript AI Agent Framework
An Open-Source Asynchronous Coding Agent
All-in-one LLM CLI tool featuring Shell Assistant, Chat-REPL, RAG, AI Tools & Agents, with access to OpenAI, Claude, Gemini, Ollama, Groq, and more.
Build, Manage and Deploy AI/ML Systems
Universal provider proxy for OpenAI Codex & Claude Code โ use any LLM (Claude, Gemini, Grok, DeepSeek, Ollamaโฆ) with Codex CLI, App, SDK, and Claude Code
High-speed Large Language Model Serving for Local Deployment
Cybersecurity AI (CAI), the framework for AI Security
Swap GPT for any LLM by changing a single line of code. Xinference lets you run open-source, speech, and multimodal models on cloud, on-prem, or your laptop โ all through one unified, production-ready inference API.
UFOยณ: Weaving the Digital Agent Galaxy
Enterprise-grade, commercial-friendly agentic workflow platform for building next-generation SuperAgents.
Deeplake is AI Data Runtime for Agents. It provides serverless postgres with a multimodal datalake, enabling scalable retrieval and training.
Omnigent is an open-source AI agent framework and meta-harness: orchestrate Claude Code, Codex, Cursor, Pi, and custom agents โ swap harnesses without rewriting, enforce policies and sandboxing, and collaborate in real time from any device.
The easiest way to serve AI apps and models - Build Model Inference APIs, Job queues, LLM apps, Multi-model pipelines, and more!
๐๐ชMaximize your efficiency and productivity. The ultimate hub to manage, customize, and share prompts. (English/ไธญๆ/Espaรฑol/ุงูุนุฑุจูุฉ). ่ฎฉ็ไบงๅๅ ๅ็ AI ๅฟซๆทๆไปคใๆด้ซๆๅฐ็ฎก็ๆ็คบ่ฏ๏ผๅจๅไบซ็คพๅบไธญๅ็ฐ้็จไบไธๅๅบๆฏ็็ตๆใ
Build effective agents using Model Context Protocol and simple workflow patterns
Accessible large language models via k-bit quantization for PyTorch.
Put an end to code hallucinations! GitMCP is a free, open-source, remote MCP server for any GitHub project
โ๏ธ๐ฆ Build modular and scalable LLM Applications in Rust
Semantic cache for LLMs. Fully integrated with LangChain and llama_index.
Open Source Deep Research Alternative to Reason and Search on Private Data. Written in Python.
LMDeploy is a toolkit for compressing, deploying, and serving LLMs.
Evidently is โโan open-source ML and LLM observability framework. Evaluate, test, and monitor any AI-powered system or data pipeline. From tabular data to Gen AI. 100+ metrics.
22 prompt engineering techniques with hands-on Jupyter Notebook tutorials, from fundamental concepts to advanced strategies for leveraging LLMs.
Fast, flexible LLM inference
AI enabled pair programmer for Claude, GPT, O Series, Grok, Deepseek, Gemini and 300+ models
Own your AI. The native macOS harness for AI agents -- any model, persistent memory, autonomous execution, cryptographic identity. Built in Swift. Fully offline. Open source.
Open-source observability for your GenAI or LLM application, based on OpenTelemetry
๐ฅ Open Source Browser API for AI Agents & Apps. Steel Browser is a batteries-included browser sandbox that lets you automate the web without worrying about infrastructure.
Adding guardrails to large language models.
An AI-powered next-generation open source real-time observability system.
Tools for merging pretrained large language models.
OpenCompass is an LLM evaluation platform, supporting a wide range of models (Llama3, Mistral, InternLM2,GPT-4,LLaMa2, Qwen,GLM, Claude, etc) over 100+ datasets.
Dynamic, resilient AI orchestration. Coordinate data, models, and compute as you build AI workflows.
Build an agent harness and control it end-to-end. Open-source SDK for production AI agents in Python & TypeScript - any model, any cloud.
The automatic work journal/time tracker. Privately turns your screen into a timeline of what you actually accomplished. Open-source and local-first.
Postgres with GPUs for ML/AI apps.
Data processing for and with foundation models! ๐ ๐ ๐ฝ โก๏ธ โก๏ธ๐ธ ๐น ๐ท
โจ AI Coding, Vim Style
TypeScript AI agent orchestration framework with dynamic workflows. Describe the goal, not the graph: a coordinator plans the task DAG at runtime and runs it on any LLM (Claude, ChatGPT, Gemini, DeepSeek, or local models).