Awesome Opensource Ai

RamaLama is an open-source developer tool that simplifies the local serving of AI models from any source and facilitates their use for inference in production, all through the familiar language of containers.

Elegant easy-to-use neural networks + scientific computing in JAX. https://docs.kidger.site/equinox/

Holistic Evaluation of Language Models (HELM) is an open source Python framework created by the Center for Research on Foundation Models (CRFM) at Stanford for holistic, reproducible and transparent evaluation of foundation models, including large language models (LLMs) and multimodal models.

pingcap/autoflow is a Graph RAG based and conversational knowledge base tool built with TiDB Serverless Vector Storage. Demo: https://tidb.ai

Probabilistic programming with NumPy powered by JAX for autograd and JIT compilation to GPU/TPU/CPU.

Modular Python framework for AI agents and workflows with chain-of-thought reasoning, tools, and memory.

Apache Hamilton helps data scientists and engineers define testable, modular, self-documenting dataflows, that encode lineage/tracing and metadata. Runs and scales everywhere python does.

An Open Standard for lineage metadata collection

Data Contracts engine for the modern data stack. https://www.soda.io

Inspect: A framework for large language model evaluations

Vendor-agnostic orchestration for training, inference and agentic workloads across NVIDIA, AMD, TPU, and Tenstorrent on clouds, Kubernetes, and bare metal.

VeOmni: Scaling Any Modality Model Training with Model-Centric Distributed Recipe Zoo

Numerical differential equation solvers in JAX. Autodifferentiable and GPU-capable. https://docs.kidger.site/diffrax/

ContextGem: Effortless LLM extraction from documents

Scalable toolkit for efficient model reinforcement

Large-scale LLM inference engine

Developer Asset Hub for NVIDIA Nemotron — A one-stop resource for training recipes, usage cookbooks, datasets, and full end-to-end reference examples to build with Nemotron models

MLRun is an open source MLOps platform for quickly building and managing continuous ML applications across their lifecycle. MLRun integrates into your development and CI/CD environment and automates the delivery of production data, ML pipelines, and online applications.

Lightweight and extensible compatibility layer between dataframe libraries!

Agentic RL Training at Scale

A fast and lightweight framework for creating decentralized agents with ease.

The LLM Anti-Framework

Open-source, end-to-end platform for evaluating, observing, and improving LLM and AI agent applications. Tracing · Evals · Simulations · Datasets · Gateway · Guardrails. Self-hostable. Apache 2.0.

bloom - evaluate any behavior immediately  🌸🌱

XAI - An eXplainability toolbox for machine learning

Scalable machine 🤖 learning for time series forecasting.

🥤 RAGLite is a Python toolkit for Retrieval-Augmented Generation (RAG) with DuckDB or PostgreSQL

Lightning fast data version control system for large repositories of data. Feels like git, pushes and pulls like oxen.

Readymade evaluators for your LLM apps

Weave is a toolkit for developing AI-powered applications, built by Weights & Biases.