Open highlighted repo slot
Put your repository first
Promote a GitHub repo at the top of Awesome repository list views for 7 days.
Awesome List
A curated list of awesome LLM frameworks, libraries and software.
GitHub stars and default-branch commits for uhub/awesome-llm.
Open highlighted repo slot
Promote a GitHub repo at the top of Awesome repository list views for 7 days.
Evidently is an open-source ML and LLM observability framework. Evaluate, test, and monitor any AI-powered system or data pipeline. From tabular data to Gen AI. 100+ metrics.
slime is an LLM post-training framework for RL Scaling.
A sample app for the Retrieval-Augmented Generation pattern running in Azure, using Azure AI Search for retrieval and Azure OpenAI large language models to power ChatGPT-style and Q&A experiences.
22 prompt engineering techniques with hands-on Jupyter Notebook tutorials, from fundamental concepts to advanced strategies for leveraging LLMs.
This repo powers my experiment where ChatGPT manages a real-money micro-cap stock portfolio.
Adding guardrails to large language models.
OpenCompass is an LLM evaluation platform, supporting a wide range of models (Llama3, Mistral, InternLM2,GPT-4,LLaMa2, Qwen,GLM, Claude, etc) over 100+ datasets.
Dynamic, resilient AI orchestration. Coordinate data, models, and compute as you build AI workflows.
Build an agent harness and control it end-to-end. Open-source SDK for production AI agents in Python & TypeScript - any model, any cloud.
The Enterprise-Grade Multi-Agent Orchestration Framework. Website: https://swarms.ai
Plano is an AI-native proxy server and data plane for agentic apps. Smart LLM routing, observability, agent orchestration, and guardrails so you stay focused on your agents core logic.
NeMo Guardrails is an open-source toolkit for easily adding programmable guardrails to LLM-based conversational systems.
Postgres with GPUs for ML/AI apps.
微信机器人,可接入DeepSeek、Gemini、ChatGPT、ChatGLM、讯飞星火、Tigerbot等大模型。微信 hook WeChat Robot Hook.
Run LLMs with MLX
Efficient Triton Kernels for LLM Training
[EMNLP'23, ACL'24] To speed up LLMs' inference and enhance LLM's perceive of key information, compress the prompt and KV-Cache, which achieves up to 20x compression with minimal performance loss.
A RWKV management and startup tool, full automation, only 8MB. And provides an interface compatible with the OpenAI API. RWKV is a large language model that is fully open source and available for commercial use.
The most powerful AI agent and AI chat software on Android/Operit是一款Android上能力最为强大、发展最久的AI Agent
Free open source crypto trading bot to automate AI, Grid, DCA and TradingView strategies on Binance, Hyperliquid and 15+ exchanges, with a simple interface.
🐬DeepChat - A smart assistant that connects powerful AI to your personal world
The first "code-first" agent framework for seamlessly planning and executing data analytics tasks.
🧊 Open source LLM observability platform. One line of code to monitor, evaluate, and experiment. YC W23 🍓
Mooncake is the serving platform for Kimi, a leading LLM service provided by Moonshot AI.
FlashInfer: Kernel Library for LLM Serving
Multi agent system for AI-driven software development. Combine LLM with DevOps tools to convert natural language requirements into working software. Supports any development language and extends the existing code.
An Open-source Framework for Data-centric, Self-evolving Autonomous Language Agents
Python SDK for AI agent monitoring, LLM cost tracking, benchmarking, and more. Integrates with most LLMs and agent frameworks including CrewAI, Agno, OpenAI Agents SDK, Langchain, Autogen, AG2, and CamelAI
A suite of tools to develop RAG, semantic search, and other AI applications more easily with PostgreSQL
Robust recipes to align language models with human and AI preferences
A large-scale 7B pretraining language model developed by BaiChuan-Inc.
Gemma open-weight LLM library, from Google DeepMind
⚡️next-generation personal AI assistant powered by LLM, RAG and agent loops, supporting computer-use, browser-use and coding agent, demo: https://demo.openagentai.org
ZenML 🙏: One AI Platform from Pipelines to Agents. https://zenml.io.
💬 Telegram bot with ChatGPT & Claude Python-based, using OpenAI's API.
The unofficial python package that returns response of Google Bard through cookie value.
A Next-Generation Training Engine Built for Ultra-Large MoE Models
🤖 AgentVerse 🪐 is designed to facilitate the deployment of multiple LLM-based agents in various applications, which primarily provides two frameworks: task-solving and simulation
Argilla is a collaboration tool for AI engineers and domain experts to build high-quality datasets
Ecommerce Search and Discovery - marqo.ai
A blazing fast inference solution for text embeddings models
AutoRAG: Now your agent can find anything in your computer. It gets smarter if you are using it frequently.
Zep | Examples, Integrations, & More
[COLM 2024] OpenAgents: An Open Platform for Language Agents in the Wild
Agenta is a workspace where you and your team build agents and automations.
A fast inference library for running LLMs locally on modern consumer-class GPUs
Plug in and Play Implementation of Tree of Thoughts: Deliberate Problem Solving with Large Language Models that Elevates Model Reasoning by atleast 70%
DeepAnalyze is the first agentic LLM for autonomous data science. 🎈你的AI数据分析师,自动分析大量数据,一键生成专业分析报告!
LLM training code for Databricks foundation models
A community-driven way to read and chat with AI bots - powered by chatGPT.