Open highlighted repo slot
Put your repository first
Promote a GitHub repo at the top of Awesome repository list views for 7 days.
Awesome List
A curated list of awesome LLM frameworks, libraries and software.
GitHub stars and default-branch commits for uhub/awesome-llm.
Open highlighted repo slot
Promote a GitHub repo at the top of Awesome repository list views for 7 days.
AutoGPT is the vision of accessible AI for everyone, to use and to build on. Our mission is to provide the tools, so that you can focus on what matters.
LLM inference in C/C++
The Memory Layer for AI Agents - Drop-in memory infrastructure for AI agents and apps. Context that persists. Built for production.
A natural language interface for computers
LlamaIndex is the leading document agent and OCR platform
Build resilient agents.
Langchain-Chatchat(原Langchain-ChatGLM)基于 Langchain 与 ChatGLM, Qwen 与 Llama 等语言模型的 RAG 与 Agent 应用 | Langchain-Chatchat (formerly langchain-ChatGLM), local knowledge based LLM (like ChatGLM, Qwen and Llama) RAG and Agent app with langchain
The Frontend Stack for Agents & Generative UI. React, Angular, Mobile, Slack, and more. Makers of the AG-UI Protocol
🤖 Assemble, configure, and deploy autonomous AI Agents in your browser.
📑 PageIndex: Document Index for Vectorless, Reasoning-based RAG
Cognee is the open-source AI memory platform for agents. Give your AI agents persistent long-term memory across sessions with a self-hosted knowledge graph engine.
An autonomous agent that conducts deep research on any data using any LLM providers
The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, and optimize production-quality AI applications while controlling costs and managing access to models and data.
Chat with your database or your datalake (SQL, CSV, parquet). PandasAI makes data analysis conversational using LLMs and RAG.
Build reliable customer-facing AI agents with Parlant: an interaction control harness optimized for controlled, consistent, and predictable LLM interactions.
The LLM Evaluation Framework
TensorRT LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and supports state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. TensorRT LLM also contains components to create Python and C++ runtimes that orchestrate the inference execution in a performant way.
Build high-quality LLM apps - from prototyping, testing to production deployment and monitoring.
Official inference library for Mistral models
Self-evolving memory OS for LLM & AI Agents: ultra-persistent memory, hybrid-retrieval, and cross-task skill reuse, with 35.24% token savings
High-speed Large Language Model Serving for Local Deployment
Enterprise-grade, commercial-friendly agentic workflow platform for building next-generation SuperAgents.
PraisonAI 🦞 — Hire a 24/7 AI Workforce. Stop writing boilerplate and start shipping autonomous self-improving agents that research, plan, code, and execute tasks. Deployed in 5 lines of code with built-in memory, RAG, and support for 100+ LLMs.
Adding guardrails to large language models.
The Enterprise-Grade Multi-Agent Orchestration Framework. Website: https://swarms.ai
Postgres with GPUs for ML/AI apps.
🧊 Open source LLM observability platform. One line of code to monitor, evaluate, and experiment. YC W23 🍓
A blazing fast inference solution for text embeddings models
AutoRAG: Now your agent can find anything in your computer. It gets smarter if you are using it frequently.
Plug in and Play Implementation of Tree of Thoughts: Deliberate Problem Solving with Large Language Models that Elevates Model Reasoning by atleast 70%
A fast multimodal LLM for real-time voice
Your agent in your terminal, equipped with local tools: writes code, uses the terminal, browses the web. Make your own persistent autonomous agent on top!
ChatGPT Plus 共享方案。ChatGPT Plus / OpenAI API sharing solution.
A language for constraint-guided and efficient LLM programming.
AdalFlow: The library to build & auto-optimize LLM applications.
Evaluation and Tracking for LLM Experiments and AI Agents
A library of data loaders for LLMs made by the community -- to be used with LlamaIndex and/or LangChain
A personal knowledge base that builds and maintains itself. Drop in sources — Claude (or Codex/Gemini) reads them, extracts knowledge, and maintains a persistent interlinked wiki. Works with Claude Code, Codex, OpenCode, Gemini CLI. No API key needed.
Build production-ready AI agents in both Python and Typescript.
Stop configuring your AI stack. Start using it. One command brings a complete pre-wired LLM stack with hundreds of services to explore.
SRE Agent - CNCF Sandbox Project
README file generator, powered by AI.
Infinity is a high-throughput, low-latency serving engine for text-embeddings, reranking models, clip, clap and colpali
All-in-one platform for search, recommendations, RAG, and analytics offered via API
DeepTeam is a framework to red team LLMs and AI agents.
Auto-GPT中文版本及爱好者组织 同步更新原项目 AI领域创业 自媒体组织 用AI工作学习创作变现
Python & JS/TS SDK for running AI-generated code/code interpreting in your AI app
🤖Self-Modifying Framework from the Future 🔮 World's First AMS
🤖 Create agentic apps in a second with your prompts. Everything you need to create an LLM Agent - tools, prompts, frameworks, and models - all in one place.
🤖 Deploy a private ChatGPT alternative hosted within your VPC. 🔮 Connect it to your organization's knowledge base and use it as a corporate oracle. Supports open-source LLMs like Llama 2, Falcon, and GPT4All.