Search awesome repositories

Python & Command-line tool to gather text and metadata on the Web: Crawling, scraping, extraction, output as CSV, JSON, HTML, MD, TXT, XML

Statistical Machine Intelligence & Learning Engine

Local-first healthcare AI: clinical NER & HIPAA PII de-identification that runs 100% on-device. 2,200+ medical models, 21 languages, Apple MLX + Python, no cloud, no patient data leaving your network. Apache-2.0

AI가 쓴 한글을 사람 글처럼 윤문하는 Claude 스킬 — Korean AI-text humanizer: detects and rewrites translationese, mechanical parallelism, and 71 other AI tells

The unofficial python package that returns response of Google Bard through cookie value.

Argilla is a collaboration tool for AI engineers and domain experts to build high-quality datasets

An easy-to-use LLMs quantization package with user-friendly apis, based on GPTQ algorithm.

Repo for BenCao [original name: HuaTuo (华驼)], Instruction-tuning Large Language Models with Chinese Medical Knowledge. 本草（原名：华驼）模型仓库，基于中文医学知识的大语言模型指令微调

A C library for parsing/normalizing street addresses around the world. Powered by statistical NLP and open geo data.

Prompt Engineering, Generative AI, and LLM Guide by Learn Prompting | Join our discord for the largest Prompt Engineering learning community

Prompt Engineering | Prompt Versioning | Use GPT or other prompt based models to get structured output. Join our discord for Prompt-Engineering, LLMs and other latest research

《大语言模型》作者：赵鑫，李军毅，周昆，唐天一，文继荣

General technology for enabling AI capabilities w/ LLMs and MLLMs

LLM training code for Databricks foundation models

LightLLM is a Python-based LLM (Large Language Model) inference and serving framework, notable for its lightweight design, easy scalability, and high-speed performance.

MNBVC(Massive Never-ending BT Vast Chinese corpus)超大规模中文语料集。对标chatGPT训练的40T数据。MNBVC数据集不但包括主流文化，也包括各个小众文化甚至火星文的数据。MNBVC数据集包括新闻、作文、小说、书籍、杂志、论文、台词、帖子、wiki、古诗、歌词、商品介绍、笑话、糗事、聊天记录等一切形式的纯文本中文数据。

AdalFlow: The library to build & auto-optimize LLM applications.

State of the Art Natural Language Processing

Language model tokenization at GB/s

Superfast AI decision making and intelligent processing of multi-modal data.

中文 NLP 预处理、解析工具包，准确、高效、易用 A Chinese NLP Preprocessing & Parsing Package www.jionlp.com

Datawhale成员整理的面经，内容包括机器学习，CV，NLP，推荐，开发等，欢迎大家star

Module for automatic summarization of text documents and HTML pages.

Models, data loaders and abstractions for language processing, powered by PyTorch

🛠 All-in-one web-based IDE specialized for machine learning and data science.

TextAttack 🐙 is a Python framework for adversarial attacks, data augmentation, and model training in NLP https://textattack.readthedocs.io/en/master/

Open-source inference server and production cluster for all the models your agent needs.

Must-read Papers on LLM Agents.

Rust native ready-to-use NLP pipelines and transformer-based models (BERT, DistilBERT, GPT2,...)

Chinese-LLaMA 1&2、Chinese-Falcon 基础模型；ChatFlow中文对话模型；中文OpenLLaMA模型；NLP预训练/指令微调数据集