HomeCoursesIntroduction to Distributed Systems for Dummies

4.7

Beginner

14h

Introduction to Distributed Systems for Dummies

Gain insights into distributed systems, learn architectural patterns like replication and sharding, and explore Apache Spark and Druid to design and develop effective distributed applications.

Join 2.7 million developers at

Overview

Content

Reviews

Gone are the days when monolithic applications were the norm. Most applications that we use today are too complex for that type of construction. Instead, most applications that appear as a single unit are actually built as a collection of inter-operating but independent computational components. Developers are expected to have mastery over a programming language or two. Moreover, they should also know the basics of distributed systems in order to succeed. In this course, you’ll learn what a distributed system is, followed by the challenges unique to distributed systems. You’ll cover popular architectural patterns for achieving targets like replication and sharding. You’ll finish with a study of two popular distributed systems: Apache Spark and Apache Druid. With the knowledge gained through this course, you’ll be able to design and develop distributed systems. You’ll be able to make optimal design and architectural choices based on the application requirements.

Gone are the days when monolithic applications were the norm. Most applications that we use today are too complex for that type ...Show More

WHAT YOU'LL LEARN

Mastery over the nature of and the need for distributed systems

An understanding of the core problems in developing distributed systems

Appreciation of the challenges in distributed systems related to storage, communication, and processing

Familiarity with key architectural patterns in distributed system design

In-depth knowledge through case studies of some popular distributed systems

Mastery over the nature of and the need for distributed systems

Content

53 Lessons12 Quizzes

Introduction

5 Lessons

Step through the essentials of distributed systems and their significance for modern applications.

Welcome to the Course

What is a Distributed System?

An Example from Scratch

The Why of Distributed Systems

Quick Quiz #1: The What and Why of Distributed Systems

What Distributed Systems Achieve for Us

14 Lessons

Unpack the core of fault tolerance, reliability, availability, scalability, load balancing, and maintainability in distributed systems.

Fault Tolerance

Reliability

Handling Hardware and Software Faults

Quick Quiz #2: Fault Tolerance and Reliability

Availability

Achieving Availability

Quick Quiz #3: Availability in Distributed Systems

Scalability

Load Balancing in Distributed Systems

Load Balancing Algorithms

Measuring Load and Performance

Quick Quiz #4: Scalability and Load Balancers

Maintainability

Quick Quiz #5: Maintainability

Data in Distributed Systems

16 Lessons

Examine key concepts of data management, replication, partitioning, consistency, and caching in distributed systems.

The Rise of Data

Replication

Replication Techniques

Replication Types and Node Outages

Quick Quiz #6: Replication

Data Partitioning

Partitioning Techniques

Consistent Hashing

Quick Quiz #7: Partitioning

Consistency

Tunable Consistency

Quick Quiz #8: Consistency

Caching

Time to Leave and Eviction Policies in Caching

Writing Policies for Caching

Quick Quiz #9: Caching

Communication Between Nodes

4 Lessons

Grasp the fundamentals of database communication, microservice protocols, and asynchronous messaging in distributed systems.

Communication via Databases

Communication in Services

Communication Through Asynchronous Messages

Quick Quiz #10: Communication between Nodes

Data Processing in Large Scale

4 Lessons

Solve problems in large-scale data processing using batch and stream processing techniques.

Batch Processing

MapReduce in Batch Processing

Stream Processing

Quick Quiz #11: Data Processing in Large Scale

Distributed System Architectural Patterns

5 Lessons

Follow the process of implementing replicated, sharded, lambda, and CQRS patterns in distributed systems.

Replicated Load-Balanced Services

Sharded Services

Lambda Architecture

Command Query Responsibility Segregation (CQRS)

Quick Quiz #12: Distributed Systems Architecture Patterns

Case Study 1: Apache Spark

2 Lessons

Master the steps to efficiently handle and analyze big data using Apache Spark.

Big Data and Apache Spark

Architecture of Apache Spark

Case Study 2: Apache Druid

2 Lessons

Learn how to use Apache Druid and understand its distinct OLAP database architecture.

OLTP and OLAP Databases

Architecture of Apache Druid

Conclusion

1 Lessons

Look at practical tips, resources, and encouragement for success in distributed systems.

Wrap Up!

Certificate of Completion

Showcase your accomplishment by sharing your certificate of completion.

Course Author:

Mottakin Chowdhury

Developed by MAANG Engineers

Every Educative lesson is designed by our in-house team of ex-MAANG software engineers and PhD computer science educators, and developed in consultation with developers and data scientists working at Meta, Google, and more. Our mission is to get you hands-on with the necessary skills to stay ahead in a constantly changing industry. No video, no fluff. Just interactive, project-based learning with personalized feedback that adapts to your goals and experience.

Trusted by 2.7 million developers working at companies

"These are high-quality courses. Trust me. I own around 10 and the price is worth it for the content quality. EducativeInc came at the right time in my career. I'm understanding topics better than with any book or online video tutorial I've done. Truly made for developers. Thanks"

Anthony Walker

@_webarchitect_

"Just finished my first full #ML course: Machine learning for Software Engineers from Educative, Inc. ... Highly recommend!"

Evan Dunbar

ML Engineer

"You guys are the gold standard of crash-courses... Narrow enough that it doesn't need years of study or a full blown book to get the gist, but broad enough that an afternoon of Googling doesn't cut it."

Software Developer

Carlos Matias La Borde

"I spend my days and nights on Educative. It is indispensable. It is such a unique and reader-friendly site"

Souvik Kundu

Front-end Developer

"Your courses are simply awesome, the depth they go into and the breadth of coverage is so good that I don't have to refer to 10 different websites looking for interview topics and content."

Vinay Krishnaiah

Software Developer

Hands-on Learning Powered by AI

See how Educative uses AI to make your learning more immersive than ever before.

Personalized Interview Prep

Skip the LeetCode grind with a custom roadmap that adapts to your goals. Hands-on practice for Coding Interviews, System Design, and more.

Mock Interviews

Test your skills in a simulated interview setting. Receive personalized feedback based on your performance. Available for Coding Interviews, System Design, and more.

AI Prompt

Build prompt engineering skills. Practice implementing AI-informed solutions.

Code Feedback

Evaluate and debug your code with the click of a button. Get real-time feedback on test cases, including time and space complexity of your solutions.

Explain with AI

Select any text within any Educative course, and get an instant explanation — without ever leaving your browser.

AI Code Mentor

AI Code Mentor helps you quickly identify errors in your code, learn from your mistakes, and nudge you in the right direction — just like a 1:1 tutor!

Free Resources

FOR TEAMS

Interested in this course for your business or team?

Unlock this course (and 1,000+ more) for your entire org with DevPath