Awesome Opensource Ai

No description.

Build and run agents you can see, understand and trust.

AirLLM 70B inference with single 4GB GPU

A lightweight, powerful framework for multi-agent workflows

Integrate cutting-edge LLM technology quickly and easily into your apps

DeepSeek-native AI coding agent for your terminal. Engineered around prefix-cache stability — leave it running.

Mastra is the modern TypeScript framework for AI-powered applications and agents.

The AI Toolkit for TypeScript. From the creators of Next.js, the AI SDK is a free open-source library for building AI-powered applications and agents

Open-source AI orchestration framework for building context-engineered, production-ready LLM applications. Design modular pipelines and agent workflows with explicit control over retrieval, routing, memory, and generation. Built for scalable agents, RAG, multimodal applications, semantic search, and conversational systems.

TencentDB Agent Memory is a team-level memory hub for AI Agents — turning conversations, docs, and code into four reusable memory assets (Chat Memory, Skill, LLM-Wiki, Code-Graph) that are governed, shared, and equipped across agents and frameworks.

Platform for stateful agents: AI with advanced memory that can learn and self-improve over time.

Test your prompts, agents, and RAGs. Red teaming/pentesting/vulnerability scanning for AI. Compare performance of GPT, Claude, Gemini, DeepSeek, and more. Simple declarative configs with command line and CI/CD integration. Used by OpenAI and Anthropic.

⌥ AI Coding agent for the terminal — hash-anchored edits, optimized tool harness, LSP, Python, browser, subagents, and more

Universal LLM Deployment Engine with ML Compilation

🔥 MaxKB is an open-source platform for building enterprise-grade agents. 强大易用的开源企业级智能体平台。

Large-scale Self-supervised Pre-training Across Tasks, Languages, and Modalities

🤗 The largest hub of ready-to-use datasets for AI models with fast, easy-to-use and efficient data manipulation tools

🤗 PEFT: State-of-the-art Parameter-Efficient Fine-Tuning.

Debug, evaluate, and monitor your LLM applications, RAG systems, and agentic workflows with comprehensive tracing, automated evaluations, and production-ready dashboards.

An open-source, code-first Python toolkit for building, evaluating, and deploying sophisticated AI agents with flexibility and control.

open-source agentic AI data assistant for the next generation of AI + Data products.

AI Agent Framework, the Pydantic way

The most RAM efficient harness

High-performance In-browser LLM Inference Engine

Build reliable customer-facing AI agents with Parlant: an interaction control harness optimized for controlled, consistent, and predictable LLM interactions.

Private AI platform for agents, assistants and enterprise search. Built-in Agent Builder, Deep research, Document analysis, Multi-model support, and API connectivity for agents.

GenBI (Generative BI) for AI agents, an open-source, governed text-to-SQL through an open context layer that turns natural-language questions into trusted dashboards, charts, and SQL across 20+ data sources, such as BigQuery, Snowflake, PostgreSQL, ClickHouse, Amazon Redshift, Databricks and more.

MNN: A blazing-fast, lightweight inference engine battle-tested by Alibaba, powering high-performance on-device LLMs and Edge AI.

Supercharge Your LLM Application Evaluations 🚀

Use PEFT or Full-parameter to CPT/SFT/DPO/GRPO 600+ LLMs (Qwen3.6, DeepSeek-V4, GLM-5.1, InternLM3, Llama4, ...) and 300+ MLLMs (Qwen3-VL, Qwen3-Omni, InternVL3.5, Ovis2.5, GLM4.5v, Gemma4, Llava, Phi4, ...) (AAAI 2025).

Unified framework for building enterprise RAG pipelines with small, specialized models

Nano vLLM

Talk to any LLM with hands-free voice interaction, voice interruption, and Live2D taking face running locally across platforms

20+ high-performance LLMs with recipes to pretrain, finetune and deploy at scale.

Unity MCP acts as a bridge between AI assistants and your Unity Editor. Give your LLM tools to manage assets, control scenes, edit scripts, and automate tasks within Unity.

Easy-to-use and powerful LLM and SLM library with awesome model zoo.

LangChain4j is an idiomatic, open-source Java library for building LLM-powered applications on the JVM. It offers a unified API over popular LLM providers and vector stores, and makes implementing tool calling (including MCP support), agents and RAG easy. It integrates seamlessly with enterprise Java frameworks like Quarkus and Spring Boot.

💡 All-in-one AI framework for semantic search, LLM orchestration and language model workflows

A blazing fast AI Gateway with integrated guardrails. Route to 1,600+ LLMs, 50+ AI Guardrails with 1 fast & friendly API.

Run any open-source LLMs, such as DeepSeek and Llama, as OpenAI compatible API endpoint in the cloud.

Go ahead and axolotl questions

Retrieval and Retrieval-augmented LLMs

Trae Agent is an LLM-based agent for general purpose software engineering tasks.

Graph-Native Infrastructure for Context and Accountable AI Systems

Convert any URL to an LLM-friendly input with a simple prefix https://r.jina.ai/

Low-code framework for building custom LLMs, neural networks, and other AI models

TensorZero is an open-source LLMOps platform that unifies an LLM gateway, observability, evaluation, optimization, and experimentation.

Run GGUF models easily with a KoboldAI UI. One File. Zero Install.

Build high-quality LLM apps - from prototyping, testing to production deployment and monitoring.

LMCache: Supercharge Your LLM with the Fastest KV Cache Layer