Data Pipeline Orchestration Tools

Ranking methodology

In development — no version effective yet.

Decision archetype: data · Scores are category-relative (P-01) and commercial relationships never affect rank (P-04).

Filters

Filters apply to structured facts only. Tools lacking a fact don't match its filter (P-02).

Apache AirflowApache Software Foundation

Open source

Open-source platform for programmatically authoring and scheduling data pipelines.

DagsterDagster Labs

Open source

Open-source orchestrator for data assets with typed, testable data pipelines.

PrefectPrefect Technologies

Open source

Open-source workflow orchestration framework for building and scheduling data pipelines.