ETL Pipeline Example: Airflow Transform Task

After implementing the transform function in the file helper.py, the next step is to add this function as a task in our DAG. This will make it a part of the ETL pipeline.

The transform function

We also want to make sure that the transform function executes after the extract function. We can set dependencies in Airflow using the >> and << operators. To make the transform function execute immediately after the extract function, we can add the extract >> transform statement at the end of the file.