Highlighted
Open highlighted repo slot
Put your repository first
Promote a GitHub repo at the top of Awesome repository list views for 7 days.
Awesome List
Awesome Bigdata
A curated list of awesome big data frameworks, ressources and other awesomeness.
oxnr/awesome-bigdata
#awesome
#awesome-list
#bigdata
#data
#data-analytics
#data-science
#data-stream
#data-visualization
#data-warehouse
#database
#distributed-database
#series-database
#stream-processing
#streaming-data
#visualize-data
404 Not Found | https://api.github.com/repos/streamsets/datacollector | message=Not Found | rate_limit_remaining=3838 | rate_limit_reset=1788436169
- List stars
- 14,609
- README repos
- 214
- Indexed repos
- 186
- List commits
- 592
- Forks
- 2,588
- Open issues
- 5
Tracked list growth
GitHub stars and default-branch commits for oxnr/awesome-bigdata.
Latest scan 2026-09-03 10:49
Likes history
GitHub starsCommits history
Default branch commits
Latest repo push 2026-09-04
tensorflow/tensorflow
An Open Source Machine Learning Framework for Everyone
AI dev
- Updated
- 2026-08-03
- Lists
- 5 list mentions
- First commit
- 2015-11-07
- License
- Apache-2.0
- Issues
- 2,965 open
196,723
stars
- Forks
- 75,772
- Commits
- 196,961 commits
- Star growth, last 7 days
- No 7-day history
- Commit velocity, last 7 days
- No 7-day history
apache/superset
Apache Superset is a Data Visualization and Data Exploration Platform
AI dev
GitHub topics
- Updated
- 2026-09-03
- Lists
- 5 list mentions
- First commit
- 2015-07-02
- License
- Apache-2.0
- Issues
- 611 open
74,609
stars
- Forks
- 18,226
- Commits
- 22,589 commits
- Star growth, last 7 days
- +102 +0.1%
- Commit velocity, last 7 days
- +111 +0.5%
scikit-learn/scikit-learn
scikit-learn: machine learning in Python
AI dev
GitHub topics
- Updated
- 2026-08-01
- Lists
- 3 list mentions
- First commit
- 2010-01-05
- License
- BSD-3-Clause
- Issues
- 2,115 open
66,855
stars
- Forks
- 27,252
- Commits
- 33,893 commits
- Star growth, last 7 days
- No 7-day history
- Commit velocity, last 7 days
- No 7-day history
keras-team/keras
Deep Learning for humans
AI dev
GitHub topics
- Updated
- 2026-09-03
- Lists
- 4 list mentions
- First commit
- 2015-03-28
- License
- Apache-2.0
- Issues
- 223 open
64,275
stars
- Forks
- 19,773
- Commits
- 12,673 commits
- Star growth, last 7 days
- +15 0.0%
- Commit velocity, last 7 days
- +29 +0.2%
apache/airflow
Apache Airflow - A platform to programmatically author, schedule, and monitor workflows
AI dev
GitHub topics
- Updated
- 2026-09-03
- Lists
- 5 list mentions
- First commit
- 2014-10-06
- License
- Apache-2.0
- Issues
- 2,097 open
46,706
stars
- Forks
- 17,744
- Commits
- 40,787 commits
- Star growth, last 7 days
- +81 +0.2%
- Commit velocity, last 7 days
- +75 +0.2%
apache/spark
Apache Spark - A unified analytics engine for large-scale data processing
AI dev
- Updated
- 2026-08-01
- Lists
- 4 list mentions
- First commit
- 2010-03-29
- License
- Apache-2.0
- Issues
- 465 open
43,763
stars
- Forks
- 29,298
- Commits
- 49,379 commits
- Star growth, last 7 days
- No 7-day history
- Commit velocity, last 7 days
- No 7-day history
ray-project/ray
Ray is an AI compute engine. Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads.
AI dev
- Updated
- 2026-08-03
- Lists
- 5 list mentions
- First commit
- 2016-02-07
- License
- Apache-2.0
- Issues
- 3,492 open
43,414
stars
- Forks
- 7,873
- Commits
- 31,230 commits
- Star growth, last 7 days
- No 7-day history
- Commit velocity, last 7 days
- No 7-day history
getredash/redash
Make Your Company Data Driven. Connect to any data source, easily visualize, dashboard and share your data.
GitHub topics
- Updated
- 2026-08-18
- Lists
- 5 list mentions
- First commit
- 2013-10-25
- License
- BSD-2-Clause
- Issues
- 802 open
28,766
stars
- Forks
- 4,624
- Commits
- 7,979 commits
- Star growth, last 7 days
- 0 0.0%
- Commit velocity, last 7 days
- 0 0.0%
plotly/dash
Data Apps & Dashboards for Python. No JavaScript Required.
AI dev
GitHub topics
- Updated
- 2026-08-01
- Lists
- 2 list mentions
- First commit
- 2015-04-10
- License
- MIT
- Issues
- 540 open
24,360
stars
- Forks
- 2,311
- Commits
- 9,948 commits
- Star growth, last 7 days
- No 7-day history
- Commit velocity, last 7 days
- No 7-day history
matplotlib/matplotlib
matplotlib: plotting with Python
GitHub topics
- Updated
- 2026-08-25
- Lists
- 3 list mentions
- First commit
- 2003-05-12
- License
- Unknown
- Issues
- 1,473 open
23,105
stars
- Forks
- 8,452
- Commits
- 55,125 commits
- Star growth, last 7 days
- No 7-day history
- Commit velocity, last 7 days
- No 7-day history
spotify/luigi
Luigi is a Python module that helps you build complex pipelines of batch jobs. It handles dependency resolution, workflow management, visualization etc. It also comes with Hadoop support built in.
GitHub topics
- Updated
- 2026-07-18
- Lists
- 3 list mentions
- First commit
- 2011-11-17
- License
- Apache-2.0
- Issues
- 165 open
18,756
stars
- Forks
- 2,462
- Commits
- 4,320 commits
- Star growth, last 7 days
- No 7-day history
- Commit velocity, last 7 days
- No 7-day history
dagster-io/dagster
An orchestration platform for the development, production, and observation of data assets.
AI dev
- Updated
- 2026-08-22
- Lists
- 4 list mentions
- First commit
- 2018-04-30
- License
- Apache-2.0
- Issues
- 2,595 open
16,050
stars
- Forks
- 2,255
- Commits
- 27,882 commits
- Star growth, last 7 days
- No 7-day history
- Commit velocity, last 7 days
- No 7-day history
spotify/annoy
Approximate Nearest Neighbors in C++/Python optimized for memory usage and loading/saving to disk
- Updated
- 2025-10-29
- Lists
- 3 list mentions
- First commit
- 2013-02-20
- License
- Apache-2.0
- Issues
- 86 open
14,289
stars
- Forks
- 1,227
- Commits
- 911 commits
- Star growth, last 7 days
- No 7-day history
- Commit velocity, last 7 days
- No 7-day history
h2oai/h2o-3
H2O is an Open Source, Distributed, Fast & Scalable Machine Learning Platform: Deep Learning, Gradient Boosting (GBM) & XGBoost, Random Forest, Generalized Linear Modeling (GLM with Elastic Net), K-Means, PCA, Generalized Additive Models (GAM), RuleFit, Support Vector Machine (SVM), Stacked Ensembles, Automatic Machine Learning (AutoML), etc.
AI dev
Stack
GitHub topics
- Updated
- 2026-09-02
- Lists
- 3 list mentions
- First commit
- 2014-03-03
- License
- Apache-2.0
- Issues
- 2,883 open
7,499
stars
- Forks
- 2,024
- Commits
- 32,841 commits
- Star growth, last 7 days
- 0 0.0%
- Commit velocity, last 7 days
- 0 0.0%
feast-dev/feast
The Open Source Feature Store for AI/ML
AI dev
GitHub topics
- Updated
- 2026-09-02
- Lists
- 2 list mentions
- First commit
- 2018-12-10
- License
- Apache-2.0
- Issues
- 426 open
7,248
stars
- Forks
- 1,423
- Commits
- 4,719 commits
- Star growth, last 7 days
- +14 +0.2%
- Commit velocity, last 7 days
- 0 0.0%
aimhubio/aim
Aim 💫 — An easy-to-use & supercharged open-source experiment tracker.
- Updated
- 2026-08-26
- Lists
- 4 list mentions
- First commit
- 2019-05-31
- License
- Apache-2.0
- Issues
- 469 open
6,245
stars
- Forks
- 407
- Commits
- 2,265 commits
- Star growth, last 7 days
- No 7-day history
- Commit velocity, last 7 days
- No 7-day history
ml-tooling/ml-workspace
🛠 All-in-one web-based IDE specialized for machine learning and data science.
Stack
GitHub topics
- Updated
- 2024-07-26
- Lists
- 3 list mentions
- First commit
- 2019-05-27
- License
- Apache-2.0
- Issues
- 0 open
3,543
stars
- Forks
- 458
- Commits
- 847 commits
- Star growth, last 7 days
- No 7-day history
- Commit velocity, last 7 days
- No 7-day history
chdb-io/chdb
chDB is an in-process OLAP SQL Engine 🚀 powered by ClickHouse
AI dev
GitHub topics
- Updated
- 2026-07-29
- Lists
- 2 list mentions
- First commit
- 2008-12-01
- License
- Apache-2.0
- Issues
- 38 open
2,852
stars
- Forks
- 127
- Commits
- 3,368 commits
- Star growth, last 7 days
- No 7-day history
- Commit velocity, last 7 days
- No 7-day history
mara/mara-pipelines
A lightweight opinionated ETL framework, halfway between plain scripts and Apache Airflow
GitHub topics
- Updated
- 2023-12-15
- Lists
- 1 list mention
- First commit
- 2018-04-08
- License
- MIT
- Issues
- 26 open
2,089
stars
- Forks
- 100
- Commits
- 172 commits
- Star growth, last 7 days
- 0 0.0%
- Commit velocity, last 7 days
- 0 0.0%
bruin-data/bruin
Build data pipelines with SQL and Python, ingest data from different sources, add quality checks, and build end-to-end flows.
AI dev
Stack
- Updated
- 2026-08-02
- Lists
- 2 list mentions
- First commit
- 2023-07-25
- License
- Apache-2.0
- Issues
- 28 open
1,657
stars
- Forks
- 86
- Commits
- 8,067 commits
- Star growth, last 7 days
- No 7-day history
- Commit velocity, last 7 days
- No 7-day history
slothflowlabs/duckle
Open-source ETL/ELT on DuckDB. Write, wire, or draw one pipeline: 350+ components, 160+ connectors, dbt, CDC, data quality, a Python API, and MCP for AI agents. Runs anywhere, no lock-in.
GitHub topics
- Updated
- 2026-08-01
- Lists
- 2 list mentions
- First commit
- 2026-05-21
- License
- Apache-2.0
- Issues
- 56 open
904
stars
- Forks
- 72
- Commits
- 891 commits
- Star growth, last 7 days
- No 7-day history
- Commit velocity, last 7 days
- No 7-day history
IBMStreams/streamsx.topology
Develop streaming applications for IBM Streams in Python, Java & Scala.
GitHub topics
- Updated
- 2022-07-24
- Lists
- 1 list mention
- First commit
- 2015-05-28
- License
- Apache-2.0
- Issues
- 3 open
- Forks
- 43
- Commits
- 6,370 commits
- Star growth, last 7 days
- No 7-day history
- Commit velocity, last 7 days
- No 7-day history