Search awesome repositories

🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, for both inference and training.

Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)

12 Weeks, 24 Lessons, AI for All!

💫 Industrial-strength Natural Language Processing (NLP) in Python

An LLM-powered knowledge curation system that researches a topic and generates a full-length report with citations.

Open-source AI orchestration framework for building context-engineered, production-ready LLM applications. Design modular pipelines and agent workflows with explicit control over retrieval, routing, memory, and generation. Built for scalable agents, RAG, multimodal applications, semantic search, and conversational systems.

🏆 A ranked list of awesome machine learning Python libraries. Updated weekly.

Large-scale Self-supervised Pre-training Across Tasks, Languages, and Modalities

🤗 The largest hub of ready-to-use datasets for AI models with fast, easy-to-use and efficient data manipulation tools

FinGPT: Open-Source Financial Large Language Models! Revolutionize 🔥 We release the trained model on HuggingFace.

Topic Modelling for Humans

Memory layer for AI Agents. Replace complex RAG pipelines with a serverless, single-file memory layer. Give your agents instant retrieval and long-term memory.

The open-source hub to build & deploy GPT/LLM Agents ⚡️

NLTK Source

Nano vLLM

A very simple framework for state-of-the-art Natural Language Processing (NLP)

Easy-to-use and powerful LLM and SLM library with awesome model zoo.

💡 All-in-one AI framework for semantic search, LLM orchestration and language model workflows

💥 Fast State-of-the-Art Tokenizers optimized for Research and Production

OpenVINO™ is an open source toolkit for optimizing and deploying AI inference

🌸 Run LLMs at home, BitTorrent-style. Fine-tuning and inference up to 10x faster than offloading

ModelScope: bring the notion of Model-as-a-Service to life.

Stanford NLP Python library for tokenization, sentence segmentation, NER, and parsing of many human languages

Python & Command-line tool to gather text and metadata on the Web: Crawling, scraping, extraction, output as CSV, JSON, HTML, MD, TXT, XML

The unofficial python package that returns response of Google Bard through cookie value.

Argilla is a collaboration tool for AI engineers and domain experts to build high-quality datasets

A C library for parsing/normalizing street addresses around the world. Powered by statistical NLP and open geo data.

Prompt Engineering | Prompt Versioning | Use GPT or other prompt based models to get structured output. Join our discord for Prompt-Engineering, LLMs and other latest research

LLM training code for Databricks foundation models

MNBVC(Massive Never-ending BT Vast Chinese corpus)超大规模中文语料集。对标chatGPT训练的40T数据。MNBVC数据集不但包括主流文化，也包括各个小众文化甚至火星文的数据。MNBVC数据集包括新闻、作文、小说、书籍、杂志、论文、台词、帖子、wiki、古诗、歌词、商品介绍、笑话、糗事、聊天记录等一切形式的纯文本中文数据。