dagster-io/dagster

An orchestration platform for the development, production, and observation of data assets.

#analytics #dagster #data-engineering #data-integration #data-orchestrator #data-pipelines #data-science #etl #metadata #mlops #orchestration #python #scheduler #workflow #workflow-automation

Open website Open GitHub

Stars: 15,567
Forks: 2,141
Commits: 27527
Language: Python
Awesome lists: 3

Similar repositories

Data-Centric-AI-Community/fg-data-profiling

1 Line of code data quality profiling & exploratory data analysis for Pandas and Spark DataFrames.

13576 stars

Python 2 awesome lists

dlt-hub/dlt

data load tool (dlt) is an open source Python library that makes data loading easy 🛠️

5421 stars

Python 1 awesome list

langgenius/dify

Production-ready platform for agentic workflow development.

143479 stars

TypeScript 8 awesome lists

Eventual-Inc/Daft

High-performance data engine for AI and multimodal workloads. Process images, audio, video, and structured data at any scale

5542 stars

Rust 0 awesome lists

pathwaycom/pathway

Python ETL framework for stream processing, real-time analytics, LLM pipelines, and RAG.

63218 stars

Python 3 awesome lists

datachain-ai/datachain

The Context Layer for unstructured data: typed, versioned datasets over S3, GCS, Azure

2755 stars

Python 1 awesome list

Tracked growth

5 captures since 2026-05-22

Latest capture 2026-05-25 20:54

Stars history

Total stars

Commits history

Default branch commits

Metadata

Created: 2018-04-30
First commit: —
Last pushed: 2026-05-25
Website: https://dagster.io
Archived: no
Stack detected: —
License: Apache-2.0

AI development signals

AI agent config detected

50 config paths 44 files 6 directories

Claude Code 49 Gemini CLI

Key config paths

dir .claude
file CLAUDE.md
file docs/CLAUDE.md
file docs/docs/integrations/libraries/gemini.md
file examples/docs_snippets/docs_snippets_tests/snippet_checks/guides/CLAUDE.md
file js_modules/claude.md

3 more config paths detected.

Review config paths

Claude Code .claude
Claude Code .claude/agents
Claude Code .claude/agents/agent-coach.md
Claude Code .claude/agents/buildkite-expert.md
Claude Code .claude/agents/code-standards-enforcer.md
Claude Code .claude/agents/pr-update-expert.md
Claude Code .claude/coding_conventions.md
Claude Code .claude/commands
Claude Code .claude/commands/ai_update_pr.md
Claude Code .claude/commands/analyze_diamond_feedback.md
Claude Code .claude/commands/diagnose_bk_failure.md
Claude Code .claude/commands/enforce_standards.md
Claude Code .claude/commands/erk
Claude Code .claude/commands/erk/__init__.py
Claude Code .claude/commands/erk/diag-lock-error.md
Claude Code .claude/commands/erk/fix-conflicts.md
Claude Code .claude/commands/erk/git-pr-push.md
Claude Code .claude/commands/erk/land.md
Claude Code .claude/commands/erk/learn.md
Claude Code .claude/commands/erk/objective-create.md
Claude Code .claude/commands/erk/objective-list.md
Claude Code .claude/commands/erk/objective-next-plan.md
Claude Code .claude/commands/erk/objective-update-with-landed-pr.md
Claude Code .claude/commands/erk/plan-implement.md

Showing the first 24 paths. 26 more detected.