Search awesome repositories

Machine Learning Engineering Open Book

Materials for the Learn PyTorch for Deep Learning: Zero to Mastery course.

Welcome to the Llama Cookbook! This is your go to guide for Building with Llama: Getting started with Inference, Fine-Tuning, RAG. We also show you how to solve end to end problems using Llama model family and using them on various provider services

Private AI platform for agents, assistants and enterprise search. Built-in Agent Builder, Deep research, Document analysis, Multi-model support, and API connectivity for agents.

Computer Vision Annotation Tool (CVAT) is a leading platform for building high-quality visual datasets for vision AI. It offers open-source, cloud, and enterprise products, as well as labeling services, for image, video, and 3D annotation with AI-assisted labeling, quality assurance, team collaboration, analytics, and developer APIs.

Burn is a next generation tensor library and Deep Learning Framework that doesn't compromise on flexibility, efficiency and portability.

Nano vLLM

Distributed training framework for TensorFlow, Keras, PyTorch, and Apache MXNet.

RWKV (pronounced RwaKuv) is an RNN with great LLM performance, which can also be directly trained like a GPT transformer (parallelizable). We are at RWKV-7 "Goose". So it's combining the best of RNN and transformer - great performance, linear time, constant space (no kv-cache), fast training, infinite ctx_len, and free sentence embedding.

TensorRT LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and supports state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. TensorRT LLM also contains components to create Python and C++ runtimes that orchestrate the inference execution in a performant way.

A very simple framework for state-of-the-art Natural Language Processing (NLP)

An open source implementation of CLIP.

Open3D: A Modern Library for 3D Data Processing

PyTorch version of Stable Baselines, reliable implementations of reinforcement learning algorithms.

A PyTorch-based Speech Toolkit

Low-code framework for building custom LLMs, neural networks, and other AI models

This repository contains demos I made with the Transformers library by HuggingFace.

LMCache: Supercharge Your LLM with the Fastest KV Cache Layer

🐍 Geometric Computer Vision Library for Spatial AI

An elegant PyTorch deep reinforcement learning library.

Fast and Accurate ML in 3 Lines of Code

🌸 Run LLMs at home, BitTorrent-style. Fine-tuning and inference up to 10x faster than offloading

High-quality single file implementation of Deep Reinforcement Learning algorithms with research-friendly features (PPO, DQN, C51, DDPG, TD3, SAC, PPG)

Flexible and powerful tensor operations for readable and reliable code (for pytorch, jax, TF and others)

ChatRWKV is like ChatGPT but powered by RWKV (100% RNN) language model, and open source.

Swap GPT for any LLM by changing a single line of code. Xinference lets you run open-source, speech, and multimodal models on cloud, on-prem, or your laptop — all through one unified, production-ready inference API.

Containers for machine learning

Deeplake is AI Data Runtime for Agents. It provides serverless postgres with a multimodal datalake, enabling scalable retrieval and training.

Deep universal probabilistic programming with Python and PyTorch

Accelerate local LLM inference and finetuning (LLaMA, Mistral, ChatGLM, Qwen, DeepSeek, Mixtral, Gemma, Phi, MiniCPM, Qwen-VL, MiniCPM-V, etc.) on Intel XPU (e.g., local PC with iGPU and NPU, discrete GPU such as Arc, Flex and Max); seamlessly integrate with llama.cpp, Ollama, HuggingFace, LangChain, LlamaIndex, vLLM, DeepSpeed, Axolotl, etc.