Explore

EXPLORE THE CATALOGSupercharge your career with 700+ hands-on courses

View All Courses

Python

Java

JavaScript

React

Docker

Vue JS

Web Dev

DevOps

AWS

LEARNING TOOLSExplore the industry's most complete learning platform

CoursesLevel up your skills

Cloud LabsSetup-free practice with Cloud Services

Skill PathsAchieve learning goals

ProjectsBuild real-world applications

Mock InterviewsNewAI-Powered interviews

Personalized Interview PrepNewGet a custom roadmap tailored to your goals

AssessmentsBenchmark your skills

Personalized PathsGet the right resources for your goals

LEARN TO CODE

Check out our beginner friendly courses.

Pricing

For Business

Resources

NewsletterCurated insights on AI, Cloud & System Design

BlogFor developers, By developers

Free CheatsheetsDownload handy guides for tech topics

Grokking the Principles and Practices of Advanced System Design/

...

Detailed Design of Spark

Let's learn how Spark utilizes its driver and workers.

We'll cover the following...

Cluster manager
Workflow of Spark
Scheduler

Access this course and 1400+ top-rated courses and projects.

Lifetime Discount - 50% Off

$13

$24.83/month

Preview Free Lessons→

Preview Free Lessons

Prologue

File Systems

Google File System (GFS)

Google Colossus File System

Facebook's Tectonic File System

Databases

Google Bigtable

Google Megastore

Google Spanner

Key-value Stores

Many-core Key-value Store

Scaling Memcache

SILT

Amazon DynamoDB

Concurrency Management

Two-phase Locking (2PL)

Google Chubby Locking Service

ZooKeeper

Big Data Processing: Batch to Stream Processing

MapReduce

Spark

Kafka

Consensus

Understanding Consensus: Two Generals, FLP, & Byzantine Generals

Two-phase Commit

State Machine Replication

Paxos

Raft

Epilogue

Detailed Design of Spark