This course is about data engineering using GCP, Python, Kafka, PySpark, and Airflow, covering the entire data lifecycle from ingestion to transformation.
Beginner
46 Lessons
7h
Certificate of Completion
This course is about data engineering using GCP, Python, Kafka, PySpark, and Airflow, covering the entire data lifecycle from ingestion to transformation.
AI-POWERED
AI-POWERED
This course includes
This course includes
Course Overview
Data engineering is currently one of the most in-demand fields in data and technology. It intersects software engineering, DataOps, data architecture, data management, and security. Data engineers, such as analysts and data scientists, lay the foundation to serve data for consumers. In this course, you will learn the foundation of data engineering, covering different parts of the entire data life cycle: data warehouse, ingestion, transformation, orchestration, etc. You will also gain hands-on experience b...
TAKEAWAY SKILLS
Python
Sql
What You'll Learn
An understanding of the data engineering life cycle
Familiarity with the cloud data warehouse and data modeling techniques
Hands-on experience with data engineering tools such as GCP, Airflow, Spark, and dbt
The ability to build data pipelines from scratch in Python
What You'll Learn
An understanding of the data engineering life cycle
Show more
Course Content
Getting Started
Data Team Structure
Data Engineering Life Cycle
Cloud Data Architecture
Data Ingestion
Data Modeling
8 Lessons
Data Orchestration
8 Lessons
Data Quality
4 Lessons
Epilogue
1 Lesson
Appendix
1 Lesson
Course Author
Trusted by 1.4 million developers working at companies
Anthony Walker
@_webarchitect_
Evan Dunbar
ML Engineer
Carlos Matias La Borde
Software Developer
Souvik Kundu
Front-end Developer
Vinay Krishnaiah
Software Developer
Eric Downs
Musician/Entrepeneur
Kenan Eyvazov
DevOps Engineer
Souvik Kundu
Front-end Developer
Eric Downs
Musician/Entrepeneur
Anthony Walker
@_webarchitect_
Evan Dunbar
ML Engineer
See how Educative uses AI to make your learning more immersive than ever before.
Instant Code Feedback
AI-Powered Mock Interviews
Adaptive Learning
Explain with AI
AI Code Mentor