Awesome Opensource Ai

AutoGPT is the vision of accessible AI for everyone, to use and to build on. Our mission is to provide the tools, so that you can focus on what matters.

LLM inference in C/C++

🙌 OpenHands: AI-Driven Development

Open Data Platform for analysts, quants and AI agents.

A natural language interface for computers

An AI Hedge Fund Team

Universal memory layer for AI Agents

LlamaIndex is the leading document agent and OCR platform

Convert PDF to markdown + JSON quickly with high accuracy

Build resilient agents.

The Frontend Stack for Agents & Generative UI. React, Angular, Mobile, Slack, and more. Makers of the AG-UI Protocol

Search infrastructure for AI

Cognee is the open-source AI memory platform for agents. Give your AI agents persistent long-term memory across sessions with a self-hosted knowledge graph engine.

Label Studio is a multi-type data labeling and annotation tool with standardized output format

TimesFM (Time Series Foundation Model) is a pretrained time-series foundation model developed by Google Research for time-series forecasting.

No description.

Build reliable customer-facing AI agents with Parlant: an interaction control harness optimized for controlled, consistent, and predictable LLM interactions.

The LLM Evaluation Framework

FinRL®: Financial Reinforcement Learning. 🔥

Simple, unified interface to multiple Generative AI providers

TensorRT LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and supports state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. TensorRT LLM also contains components to create Python and C++ runtimes that orchestrate the inference execution in a performant way.

Build high-quality LLM apps - from prototyping, testing to production deployment and monitoring.

Run GGUF models easily with a KoboldAI UI. One File. Zero Install.

An elegant PyTorch deep reinforcement learning library.

Official inference library for Mistral models

Open source annotation tool for machine learning practitioners.

High-speed Large Language Model Serving for Local Deployment

🧙 Build, run, and manage data pipelines for integrating and transforming data.

Apache Beam is a unified programming model for Batch and Streaming data processing.

PraisonAI 🦞 — Hire a 24/7 AI Workforce. Stop writing boilerplate and start shipping autonomous self-improving agents that research, plan, code, and execute tasks. Deployed in 5 lines of code with built-in memory, RAG, and support for 100+ LLMs.

Ingest, parse, and optimize any data format ➡️ from documents to multimedia ➡️ for enhanced compatibility with GenAI frameworks

An implementation of model parallel autoregressive transformers on GPUs, based on the Megatron and DeepSpeed libraries

Adding guardrails to large language models.

The Enterprise-Grade Production-Ready Multi-Agent Orchestration Framework. Website: https://swarms.ai

🧊 Open source LLM observability platform. One line of code to monitor, evaluate, and experiment. YC W23 🍓

lakeFS - Data version control for your data lake | Git for data

Probabilistic time series modeling in Python

A blazing fast inference solution for text embeddings models

A fast multimodal LLM for real-time voice

Your agent in your terminal, equipped with local tools: writes code, uses the terminal, browses the web. Make your own persistent autonomous agent on top!

AdalFlow: The library to build & auto-optimize LLM applications.

Evaluation and Tracking for LLM Experiments and AI Agents

Build production-ready AI agents in both Python and Typescript.

Fast, Accurate, Lightweight Python library to make State of the Art Embedding

llama.cpp fork with additional SOTA quants and improved performance

Infinity is a high-throughput, low-latency serving engine for text-embeddings, reranking models, clip, clap and colpali

Python & JS/TS SDK for running AI-generated code/code interpreting in your AI app

Fully open data curation for reasoning models

DeepTeam is a framework to red team LLMs and AI agents.

Agentic LLM Vulnerability Scanner / AI red teaming kit 🧪