Awesome Opensource Ai

AutoGPT is the vision of accessible AI for everyone, to use and to build on. Our mission is to provide the tools, so that you can focus on what matters.

LLM inference in C/C++

Drop in a screenshot and convert it to clean code (HTML/Tailwind/React/Vue)

Open Data Platform for analysts, quants and AI agents.

The Memory Layer for AI Agents - Drop-in memory infrastructure for AI agents and apps. Context that persists. Built for production.

A natural language interface for computers

An AI Hedge Fund Team

LlamaIndex is the leading document agent and OCR platform

Build resilient agents.

The Frontend Stack for Agents & Generative UI. React, Angular, Mobile, Slack, and more. Makers of the AG-UI Protocol

📑 PageIndex: Document Index for Vectorless, Reasoning-based RAG

TimesFM (Time Series Foundation Model) is a pretrained time-series foundation model developed by Google Research for time-series forecasting.

Cognee is the open-source AI memory platform for agents. Give your AI agents persistent long-term memory across sessions with a self-hosted knowledge graph engine.

An autonomous agent that conducts deep research on any data using any LLM providers

Search infrastructure for AI

Label Studio is a multi-type data labeling and annotation tool with standardized output format

The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, and optimize production-quality AI applications while controlling costs and managing access to models and data.

No description.

Build reliable customer-facing AI agents with Parlant: an interaction control harness optimized for controlled, consistent, and predictable LLM interactions.

The LLM Evaluation Framework

FinRL®: Financial Reinforcement Learning. 🔥

Simple, unified interface to multiple Generative AI providers

TensorRT LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and supports state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. TensorRT LLM also contains components to create Python and C++ runtimes that orchestrate the inference execution in a performant way.

Run GGUF models easily with a KoboldAI UI. One File. Zero Install.

Build high-quality LLM apps - from prototyping, testing to production deployment and monitoring.

An elegant PyTorch deep reinforcement learning library.

Official inference library for Mistral models

Open source annotation tool for machine learning practitioners.

High-speed Large Language Model Serving for Local Deployment

🧙 Build, run, and manage data pipelines for integrating and transforming data.

Apache Beam is a unified programming model for Batch and Streaming data processing.

PraisonAI 🦞 — Hire a 24/7 AI Workforce. Stop writing boilerplate and start shipping autonomous self-improving agents that research, plan, code, and execute tasks. Deployed in 5 lines of code with built-in memory, RAG, and support for 100+ LLMs.

Ingest, parse, and optimize any data format ➡️ from documents to multimedia ➡️ for enhanced compatibility with GenAI frameworks

An implementation of model parallel autoregressive transformers on GPUs, based on the Megatron and DeepSpeed libraries

Adding guardrails to large language models.

The Enterprise-Grade Multi-Agent Orchestration Framework. Website: https://swarms.ai

🧊 Open source LLM observability platform. One line of code to monitor, evaluate, and experiment. YC W23 🍓

lakeFS - Data version control for your data lake | Git for data

Probabilistic time series modeling in Python

A blazing fast inference solution for text embeddings models

AutoRAG: Now your agent can find anything in your computer. It gets smarter if you are using it frequently.

A fast multimodal LLM for real-time voice

Your agent in your terminal, equipped with local tools: writes code, uses the terminal, browses the web. Make your own persistent autonomous agent on top!

AdalFlow: The library to build & auto-optimize LLM applications.

Evaluation and Tracking for LLM Experiments and AI Agents

Build production-ready AI agents in both Python and Typescript.

Fast, Accurate, Lightweight Python library to make State of the Art Embedding

llama.cpp fork with additional SOTA quants and improved performance

Infinity is a high-throughput, low-latency serving engine for text-embeddings, reranking models, clip, clap and colpali

DeepTeam is a framework to red team LLMs and AI agents.