Orchestration Tool: dbt

Both Airflow and Dagster are great data orchestration tools, but they require significant engineering efforts. It can become a bottleneck for data analysts and analytics engineers to build data transformation pipelines using SQL as the primary language. In this chapter, it would be a shame not to mention dbt, whose revolution has transformed how data is managed, transformed, and analyzed, leading to high data quality and greater efficiency and collaboration within data teams. To some extent, dbt is a transformation workflow, rather than a pure orchestration tool.

History