Awesome Llm

Infinity is a high-throughput, low-latency serving engine for text-embeddings, reranking models, clip, clap and colpali

Holistic Evaluation of Language Models (HELM) is an open source Python framework created by the Center for Research on Foundation Models (CRFM) at Stanford for holistic, reproducible and transparent evaluation of foundation models, including large language models (LLMs) and multimodal models.

The hub for EleutherAI's work on interpretability and learning dynamics

Benchmarking large language models' complex reasoning ability with chain-of-thought prompting

Minimalistic large language model 3D-parallelism training

Lighteval is your all-in-one toolkit for evaluating LLMs across multiple backends

Seamlessly integrate LLMs as Python functions

OpenAGI: When LLM Meets Domain Experts

Mesh TensorFlow: Model Parallelism Made Easier

MemFree - Hybrid AI Search Engine & AI Page Generator

Build production-ready LLM applications and advanced agents using Python, LangChain, and LangGraph. This is the companion repository for the book on generative AI with LangChain.

A security scanner for your LLM agentic workflows

Make your LLM agent and chat with it simple and fast!