Orchestration Tool: Dagster

At the time when Airflow was created, it was no doubt an amazing technology and quickly became the pioneer in the field of data orchestration. However, several years later, the limitations of Airflow became increasingly evident, and data teams began encountering a range of difficulties. For example, Airflow pipelines are not easy to develop and test outside of production deployment, and data is not given priority in Airflow, making it challenging to link the data assets that are important to us with the corresponding tasks.

The founder of Dagster saw these challenges as an ...