Awesome Chatgpt

A high-throughput and memory-efficient inference and serving engine for LLMs

LlamaIndex is the leading document agent and OCR platform

aider is AI pair programming in your terminal

In-depth tutorials on LLMs, RAGs and real-world AI agent applications.

A modular graph-based Retrieval-Augmented Generation (RAG) system

The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, and optimize production-quality AI applications while controlling costs and managing access to models and data.

What are the principles we can use to build LLM-powered software that is actually good enough to put in the hands of production customers?

面向开发者的 LLM 入门教程，吴恩达大模型系列课程中文版

FinGPT: Open-Source Financial Large Language Models! Revolutionize 🔥 We release the trained model on HuggingFace.

Tongyi Deep Research, the Leading Open-source Deep Research Agent

TensorRT LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and supports state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. TensorRT LLM also contains components to create Python and C++ runtimes that orchestrate the inference execution in a performant way.

Retrieval and Retrieval-augmented LLMs

TensorZero is an open-source LLMOps platform that unifies an LLM gateway, observability, evaluation, optimization, and experimentation.

🐚 Python-powered shell. Full-featured, cross-platform and AI-friendly.

Running large language models on a single GPU for throughput-oriented scenarios.

The easiest way to serve AI apps and models - Build Model Inference APIs, Job queues, LLM apps, Multi-model pipelines, and more!

An Extensible Toolkit for Finetuning and Inference of Large Foundation Models. Large Models for All.

22 prompt engineering techniques with hands-on Jupyter Notebook tutorials, from fundamental concepts to advanced strategies for leveraging LLMs.

NeMo Guardrails is an open-source toolkit for easily adding programmable guardrails to LLM-based conversational systems.

Postgres with GPUs for ML/AI apps.

H2O LLM Studio - a framework and no-code GUI for fine-tuning LLMs. Documentation: https://docs.h2o.ai/h2o-llmstudio/

Argilla is a collaboration tool for AI engineers and domain experts to build high-quality datasets

Ecommerce Search and Discovery - marqo.ai

Zep | Examples, Integrations, & More

Python & JS/TS SDK for running AI-generated code/code interpreting in your AI app

Notebooks & Example Apps for Search & AI Applications with Elasticsearch

Running Llama 2 and other Open-Source LLMs on CPU Inference Locally for Document Q&A

Text to video generator in the brainrot form. Learn about any topic from your favorite personalities 😼.

Self-paced bootcamp on Generative AI. Tutorials on ML fundamentals, Ollama, LLMs, RAGs, LangChain, LangGraph, Fine-tuning, DSPy & AI Agents (CrewAI), (Using ChatGPT, gpt-oss, Claude, Qwen, Gemma, Llama, Gemini)