Home>Courses>An Introduction to Apache Airflow

An Introduction to Apache Airflow

Beginner

16 Lessons

Certificate of Completion

AI-POWERED

Explanations

AI-POWERED

Explanations

This course includes

13 Playgrounds

Course Overview

What You'll Learn

Course Content

Apply Your Skills

Course Overview

Apache Airflow has become the dominant and ubiquitous Big Data workflow management system, leaving Oozie and other competitors miles behind in terms of features and functionality. In this course, you will learn the fundamentals of Apache Airflow starting with DAGs, DagRuns, Tasks and Task Instances - the building blocks of this popular technology. You’ll then move on to understanding the architecture, creating operators and sensors, and understanding XCom. In the latter half, you’ll learn about branching...Show More

Apache Airflow has become the dominant and ubiquitous Big Data workflow management system, leaving Oozie and other competitors m...Show More

What You'll Learn

Understanding the basics of Apache Airflow

Learn to code operators, sensors, hooks, and other building blocks that make up an Airflow DAG

Interact with Airflow in browsers and see the theory read in action

Understanding the basics of Apache Airflow

Course Content

Hooks and Connections

Task Triggers and Failures

Course Author

Build a News ETL Data Pipeline Using Python and SQLite

intermediate

2 hour

Project

Build a News ETL Data Pipeline Using Python and SQLite

Learn to build an ETL pipeline for news data using Python, SQLite, and Apache Airflow for automation.

intermediate

2 hours

Project

Mastering Airflow: Building an ETL Pipeline

advanced

2 hour

Project

Mastering Airflow: Building an ETL Pipeline

Learn to automate and manage ETL pipelines using Airflow for efficient data collection and integration.

advanced

2 hours

Trusted by 2.5 million developers working at companies

"These are high-quality courses. Trust me. I own around 10 and the price is worth it for the content quality. EducativeInc came at the right time in my career. I'm understanding topics better than with any book or online video tutorial I've done. Truly made for developers. Thanks"

Anthony Walker

@_webarchitect_

"Just finished my first full #ML course: Machine learning for Software Engineers from Educative, Inc. ... Highly recommend!"

Evan Dunbar

ML Engineer

"You guys are the gold standard of crash-courses... Narrow enough that it doesn't need years of study or a full blown book to get the gist, but broad enough that an afternoon of Googling doesn't cut it."

Carlos Matias La Borde

Software Developer

"I spend my days and nights on Educative. It is indispensable. It is such a unique and reader-friendly site"

Souvik Kundu

Front-end Developer

"Your courses are simply awesome, the depth they go into and the breadth of coverage is so good that I don't have to refer to 10 different websites looking for interview topics and content."

Vinay Krishnaiah

Software Developer

"I've tried probably 5-7 different sites and Educative is easily the best. It perfectly blends explanation with interactivity"

Eric Downs

Musician/Entrepeneur

Hands-on Learning Powered by AI

See how Educative uses AI to make your learning more immersive than ever before.

Instant Code Feedback

Evaluate and debug your code with the click of a button. Get real-time feedback on test cases, including time and space complexity of your solutions.

AI-Powered Mock Interviews

Put your skills to the test in a simulated interview setting. Receive personalized feedback based on your performance. Available in Premium & Premium Plus plans.

Adaptive Learning

At various checkpoints throughout Educative courses, you will be prompted to take a quick assessment. Receive a condensed curriculum tailored to your strengths and skill gaps.

Explain with AI

Select any text within any Educative course, and get an instant explanation — without ever leaving your browser.

AI Code Mentor

AI Code Mentor helps you quickly identify errors in your code, learn from your mistakes, and nudge you in the right direction — just like a 1:1 tutor!

Free Resources