Search awesome repositories

Official inference library for Mistral models

The open source codebase powering HuggingChat

LMCache: Supercharge Your LLM with the Fastest KV Cache Layer

An Open-Source Asynchronous Coding Agent

All-in-one LLM CLI tool featuring Shell Assistant, Chat-REPL, RAG, AI Tools & Agents, with access to OpenAI, Claude, Gemini, Ollama, Groq, and more.

Self-evolving memory OS for LLM & AI Agents: ultra-persistent memory, hybrid-retrieval, and cross-task skill reuse, with 35.24% token savings

Build, Manage and Deploy AI/ML Systems

AI Agent Engineering Platform built on an Open Source TypeScript AI Agent Framework

High-speed Large Language Model Serving for Local Deployment

Cybersecurity AI (CAI), the framework for AI Security

Swap GPT for any LLM by changing a single line of code. Xinference lets you run open-source, speech, and multimodal models on cloud, on-prem, or your laptop — all through one unified, production-ready inference API.

UFO³: Weaving the Digital Agent Galaxy

Deeplake is AI Data Runtime for Agents. It provides serverless postgres with a multimodal datalake, enabling scalable retrieval and training.

TencentDB Agent Memory delivers fully local long-term memory for AI Agents via a 4-tier progressive pipeline, with zero external API dependencies.

The easiest way to serve AI apps and models - Build Model Inference APIs, Job queues, LLM apps, Multi-model pipelines, and more!

🚀💪Maximize your efficiency and productivity. The ultimate hub to manage, customize, and share prompts. (English/中文/Español/العربية). 让生产力加倍的 AI 快捷指令。更高效地管理提示词，在分享社区中发现适用于不同场景的灵感。

Enterprise-grade, commercial-friendly agentic workflow platform for building next-generation SuperAgents.

Build effective agents using Model Context Protocol and simple workflow patterns

Accessible large language models via k-bit quantization for PyTorch.

Coding Agent Harness

Put an end to code hallucinations! GitMCP is a free, open-source, remote MCP server for any GitHub project

Semantic cache for LLMs. Fully integrated with LangChain and llama_index.

Open Source Deep Research Alternative to Reason and Search on Private Data. Written in Python.

LMDeploy is a toolkit for compressing, deploying, and serving LLMs.

⚙️🦀 Build modular and scalable LLM Applications in Rust

Evidently is ​​an open-source ML and LLM observability framework. Evaluate, test, and monitor any AI-powered system or data pipeline. From tabular data to Gen AI. 100+ metrics.

22 prompt engineering techniques with hands-on Jupyter Notebook tutorials, from fundamental concepts to advanced strategies for leveraging LLMs.

Fast, flexible LLM inference

AI enabled pair programmer for Claude, GPT, O Series, Grok, Deepseek, Gemini and 300+ models

🔥 Open Source Browser API for AI Agents & Apps. Steel Browser is a batteries-included browser sandbox that lets you automate the web without worrying about infrastructure.