Awesome Bigdata

An Open Source Machine Learning Framework for Everyone

Apache Superset is a Data Visualization and Data Exploration Platform

scikit-learn: machine learning in Python

Deep Learning for humans

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

Apache Spark - A unified analytics engine for large-scale data processing

Ray is an AI compute engine. Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads.

Make Your Company Data Driven. Connect to any data source, easily visualize, dashboard and share your data.

Data Apps & Dashboards for Python. No JavaScript Required.

matplotlib: plotting with Python

Luigi is a Python module that helps you build complex pipelines of batch jobs. It handles dependency resolution, workflow management, visualization etc. It also comes with Hadoop support built in.

An orchestration platform for the development, production, and observation of data assets.

Approximate Nearest Neighbors in C++/Python optimized for memory usage and loading/saving to disk

H2O is an Open Source, Distributed, Fast & Scalable Machine Learning Platform: Deep Learning, Gradient Boosting (GBM) & XGBoost, Random Forest, Generalized Linear Modeling (GLM with Elastic Net), K-Means, PCA, Generalized Additive Models (GAM), RuleFit, Support Vector Machine (SVM), Stacked Ensembles, Automatic Machine Learning (AutoML), etc.

The Open Source Feature Store for AI/ML

Aim 💫 — An easy-to-use & supercharged open-source experiment tracker.

🛠 All-in-one web-based IDE specialized for machine learning and data science.

A lightweight opinionated ETL framework, halfway between plain scripts and Apache Airflow

Build data pipelines with SQL and Python, ingest data from different sources, add quality checks, and build end-to-end flows.

Develop streaming applications for IBM Streams in Python, Java & Scala.