CLOUD LABS
Building ETL Pipelines on AWS
In this Cloud Lab, you’ll learn how to create an ETL data pipeline with AWS Glue.
intermediate
Certificate of Completion
Learning Objectives
AWS Glue is a serverless data integration service that makes it easier to discover, prepare, move, and integrate data from multiple sources. It provides ETL (extract, transform, load) service, which is a process used in data engineering to extract data from various sources, transform it into a desired format, and load it into a target data store for analysis, reporting, and business intelligence. AWS Glue simplifies the ETL process, making it easier for businesses to prepare and transform their data for analytics.
In this Cloud Lab, you’ll create a DynamoDB table as source data. You’ll set up a database in AWS Glue with the DynamoDB table as its source. After that, you’ll use the AWS Glue crawler to fetch metadata from the DynamoDB table and into Data Catalog tables in the Glue database. You’ll then set up an ETL pipeline in AWS Glue and extract data from the Glue database, perform transformations on the data, and load the resulting data in the S3 bucket.
After the completion of this Cloud Lab, the provisioned infrastructure will be similar to the one given below:
Before you start...
Try these optional labs before starting this lab.
Relevant Course
Use the following content to review prerequisites or explore specific concepts in detail.
Trusted by 1.4 million developers working at companies including
Your method is simple, straight to the point and I can practice with it everywhere, even from my phone, that's something I have never had in other learning platforms.
![TestimonialsImg](/static/imgs/FelipeMatheus.png)
I highly recommend Educative. The courses are well organized and easy to understand.
![TestimonialsImg](/static/imgs/AdinaOng.png)
I prefer Educative courses because they have a nice mix of text & images. I find that with full video courses, it can often be too easy to go into passive learning mode.
![TestimonialsImg](/static/imgs/CliffordFajardo.png)
I prefer Educative courses because they have a nice mix of text & images. I find that with full video courses, it can often be too easy to go into passive learning mode.
![TestimonialsImg](/static/imgs/CliffordFajardo.png)
Your method is simple, straight to the point and I can practice with it everywhere, even from my phone, that's something I have never had in other learning platforms.
![TestimonialsImg](/static/imgs/FelipeMatheus.png)
I highly recommend Educative. The courses are well organized and easy to understand.
![TestimonialsImg](/static/imgs/AdinaOng.png)
I prefer Educative courses because they have a nice mix of text & images. I find that with full video courses, it can often be too easy to go into passive learning mode.
![TestimonialsImg](/static/imgs/CliffordFajardo.png)
Get access to Educative Cloud Labs