Search every repository hiding inside awesome lists.

Apache Spark - A unified analytics engine for large-scale data processing

Apache Flink

Open-source IoT Platform - Device management, data collection, processing and visualization.

The Data Engineering Cookbook

Cloud-native search engine for observability. An open-source alternative to Datadog, Elasticsearch, Loki, and Tempo.

The most widely used Python to C compiler

A fast, scalable, high performance Gradient Boosting on Decision Trees library, used for ranking, classification, regression and other machine learning tasks for Python, R, Java, C++. Supports computation on CPU and GPU.

Apache DataFusion SQL Query Engine

An open-source storage framework that enables building a Lakehouse architecture with compute engines including Spark, PrestoDB, Flink, Trino, and Hive and APIs

Apache Beam is a unified programming model for Batch and Streaming data processing.

H2O is an Open Source, Distributed, Fast & Scalable Machine Learning Platform: Deep Learning, Gradient Boosting (GBM) & XGBoost, Random Forest, Generalized Linear Modeling (GLM with Elastic Net), K-Means, PCA, Generalized Additive Models (GAM), RuleFit, Support Vector Machine (SVM), Stacked Ensembles, Automatic Machine Learning (AutoML), etc.

The Open Source Feature Store for AI/ML

High-performance data engine for AI and multimodal workloads. Process images, audio, video, and structured data at any scale

Simple and Distributed Machine Learning

A crazy fast analytical database, built on bitmaps. Perfect for ML applications. Learn more at: http://docs.featurebase.com/. Start a Docker instance: https://hub.docker.com/r/featurebasedb/featurebase

A large-scale entity and relation database supporting aggregation of properties

📈 Collect customer event data from your apps. (Note that this project only includes the API collector, not the visualization platform)

Serverless proxy for Spark cluster

The Archives Unleashed Toolkit is an open-source toolkit for analyzing web archives.