Awesome Bigdata

Apache Superset is a Data Visualization and Data Exploration Platform

Apache ECharts is a powerful, interactive charting and data visualization library for browser

The easy-to-use open source Business Intelligence and Embedded Analytics tool that lets everyone work with data :bar_chart:

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

Apache Spark - A unified analytics engine for large-scale data processing

Ray is an AI compute engine. Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads.

CockroachDB — the cloud native, distributed SQL database designed for high availability, effortless scale, and control over data placement.

Make Your Company Data Driven. Connect to any data source, easily visualize, dashboard and share your data.

High-performance, scalable time-series database designed for Industrial IoT (IIoT) scenarios

Data Apps & Dashboards for Python. No JavaScript Required.

matplotlib: plotting with Python

high-performance graph database for real-time use cases

Open-source JavaScript charting library behind Plotly and Dash

VictoriaMetrics: fast, cost-effective monitoring solution and time series database

An orchestration platform for the development, production, and observation of data assets.

JuiceFS is a distributed POSIX file system built on top of Redis and S3.

Highly available Prometheus setup with long term storage capabilities. A CNCF Incubating project.

Apache Druid: a high performance real-time analytics database.

A JavaScript library aimed at visualizing graphs of thousands of nodes and edges

A visualization grammar.

YugabyteDB - the cloud native distributed SQL database for mission-critical applications.

Vowpal Wabbit is a machine learning system which pushes the frontier of machine learning with techniques such as online, hashing, allreduce, reductions, learning2search, active, and interactive learning.

Simple feed-forward neural network in JavaScript

H2O is an Open Source, Distributed, Fast & Scalable Machine Learning Platform: Deep Learning, Gradient Boosting (GBM) & XGBoost, Random Forest, Generalized Linear Modeling (GLM with Elastic Net), K-Means, PCA, Generalized Additive Models (GAM), RuleFit, Support Vector Machine (SVM), Stacked Ensembles, Automatic Machine Learning (AutoML), etc.

The Open Source Feature Store for AI/ML

A damn-sexy, open source real-time dashboard builder for IOT and other web mashups. A free open-source alternative to Geckoboard.

The live data layer for apps and AI agents. Create up-to-the-second views into your business, just using SQL

Aim 💫 — An easy-to-use & supercharged open-source experiment tracker.

Agentic BI. Analytics at the speed of code ⚡️

A simple, distributed task scheduler and runner with a web based UI.

Cubism.js: A JavaScript library for time series visualization.

The AI-native database built for LLM applications, providing incredibly fast hybrid search of dense vector, sparse vector, tensor (multi-vector), and full-text.

🍰 Progressive <svg> pie, donut, bar and line charts

Deploy and manage containers (including Docker) on top of Apache Mesos at scale.

ingestr is a CLI tool to copy data between any databases with a single command seamlessly.

Apache Heron (Incubating) is a realtime, distributed, fault-tolerant stream processing engine from Twitter

In-memory dimensional time series database.

Apache Linkis builds a computation middleware layer to facilitate connection, governance and orchestration between the upper applications and the underlying data engines.

DataSphereStudio is a one stop data application development& management portal, covering scenarios including data exchange, desensitization/cleansing, analysis/mining, quality measurement, visualization, and task scheduling.

Kubernetes-native platform to run massively parallel data/streaming jobs

Web UI for PrestoDB.

A crazy fast analytical database, built on bitmaps. Perfect for ML applications. Learn more at: http://docs.featurebase.com/. Start a Docker instance: https://hub.docker.com/r/featurebasedb/featurebase

🌀 AI-native framework for building data portals. Scaffold a full portal from a brief and load datasets in minutes with agentic skills — any backend (CKAN, GitHub, Frictionless).

Build data pipelines with SQL and Python, ingest data from different sources, add quality checks, and build end-to-end flows.

HyperDex is a scalable, searchable key-value store

EliasDB a graph-based database.

An Alert Management Web Application

Open-source ETL/ELT on DuckDB. Write, wire, or draw one pipeline: 350+ components, 160+ connectors, dbt, CDC, data quality, a Python API, and MCP for AI agents. Runs anywhere, no lock-in.

Fast and reliable message broker built on top of Kafka.

Compose complex, data-driven visualizations from reusable charts and components with d3