Awesome Opensource Ai

🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, for both inference and training.

Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)

12 Weeks, 24 Lessons, AI for All!

💫 Industrial-strength Natural Language Processing (NLP) in Python

Open-source AI orchestration framework for building context-engineered, production-ready LLM applications. Design modular pipelines and agent workflows with explicit control over retrieval, routing, memory, and generation. Built for scalable agents, RAG, multimodal applications, semantic search, and conversational systems.

Large-scale Self-supervised Pre-training Across Tasks, Languages, and Modalities

🤗 The largest hub of ready-to-use datasets for AI models with fast, easy-to-use and efficient data manipulation tools

FinGPT: Open-Source Financial Large Language Models! Revolutionize 🔥 We release the trained model on HuggingFace.

Nano vLLM

Easy-to-use and powerful LLM and SLM library with awesome model zoo.

💡 All-in-one AI framework for semantic search, LLM orchestration and language model workflows

💥 Fast State-of-the-Art Tokenizers optimized for Research and Production

OpenVINO™ is an open source toolkit for optimizing and deploying AI inference

ModelScope: bring the notion of Model-as-a-Service to life.

Stanford NLP Python library for tokenization, sentence segmentation, NER, and parsing of many human languages

Argilla is a collaboration tool for AI engineers and domain experts to build high-quality datasets

Prompt Engineering | Prompt Versioning | Use GPT or other prompt based models to get structured output. Join our discord for Prompt-Engineering, LLMs and other latest research

LLM training code for Databricks foundation models

AdalFlow: The library to build & auto-optimize LLM applications.

LightLLM is a Python-based LLM (Large Language Model) inference and serving framework, notable for its lightweight design, easy scalability, and high-speed performance.

Superfast AI decision making and intelligent processing of multi-modal data.

TextAttack 🐙 is a Python framework for adversarial attacks, data augmentation, and model training in NLP https://textattack.readthedocs.io/en/master/

A library for debugging/inspecting machine learning classifiers and explaining their predictions

ContextGem: Effortless LLM extraction from documents

Code repo for "WebArena: A Realistic Web Environment for Building Autonomous Agents"

Trained models & code to predict toxic comments on all 3 Jigsaw Toxic Comment Challenges. Built using ⚡ Pytorch Lightning and 🤗 Transformers. For access to our API, please email us at contact@unitary.ai.