Cloud Data Architectures: Lambda, Kappa, and Data Warehouse
Understand three types of cloud data architectures: Lambda architecture, Kappa architecture, and data warehouse.
We'll cover the following
We will look at three widely-used cloud data architecture frameworks: Lambda architecture, Kappa architecture, and data warehouse. The list is not complete, but it encourages us to do a trade-off analysis before choosing the right cloud data architecture. Cloud data architecture, by design, handles the ingestion, transformation, and analysis of data that is too large or complex for traditional data architectures.
Lambda architecture
In the mid-2010s, the rise of Apache Kafka as a stream-processing platform empowered companies to apply real-time algorithms to data, generating quicker and better insights. Given this real-time data processing trend, data engineers must figure out how to combine batch and streaming processes into one unified data architecture.
Get hands-on with 1200+ tech skills courses.