Seamless Data Movement

Even after creating a centralized data location and filling it with ingested data, there might still be a need to move a portion of the ingested data to another data store. AWS allows for this data movement from an Amazon S3 data lake to other locations using services such as AWS Glue.

Why move data?

Let's consider a few scenarios where data movement becomes important.

Designing systems that handle failure

In designing engineering systems, it’s often a good idea to create systems that meet use cases and requirements using the least number of components. Each additional component adds complexity and a new potential for failure.

Imagine if cars had extra engines or electric motors. Not only would they add more weight to the car, but the extra components would also take up more physical space and add to the car’s total costs.

However, redundancy can become necessary to make systems more reliable. Cars have spare ...