Deep Dive: Internals of Spark Execution

This lesson expands the previous landscape for a Spark Execution flow and Architecture.

In previous lessons, we used diagrams to slowly introduce to the reader how the Spark components interact, and how execution flow for a Spark application falls into place.

This lesson expand on this by presenting a broader picture of the Spark Landscape in a typical but straightforward application’s execution. It also dives into two of the most common cluster topologies in which a Spark application can run.

The big picture

A diagram of the Spark ecosystem while executing a program is below:

Get hands-on with 1400+ tech skills courses.