Deep Dive: Internals of Spark Execution
This lesson expands the previous landscape for a Spark Execution flow and Architecture.
In previous lessons, we used diagrams to slowly introduce to the reader how the Spark components interact, and how execution flow for a Spark application falls into place.
This lesson expand on this by presenting a broader picture of the Spark Landscape in a typical but straightforward application’s execution. It also dives into two of the most common cluster topologies in which a Spark application can run.
The big picture
A diagram of the Spark ecosystem while executing a program is below:
Get hands-on with 1400+ tech skills courses.