An Introduction to Spark - AI-Powered Course

Home>

Courses>

An Introduction to Spark

An introductory course for getting familiar with Spark and learning the basics of manipulating data using Spark.

Beginner

26 Lessons

2h 50min

Certificate of Completion

An introductory course for getting familiar with Spark and learning the basics of manipulating data using Spark.

AI-POWERED

Explanations

AI-POWERED

Explanations

This course includes

20 Playgrounds

This course includes

20 Playgrounds

Course Overview

Spark has come to dominate the big data processing space in a short span of time since its release and now serves as the de-facto unified big data processing engine in the industry. In this course, you will get a complete introduction to the basics of Spark. You will start by learning about the architecture, the application lifecycle, and its API. From there, you will dive into the data frame data structure and its API as well as the strongly-typed datasets API. Lastly, you’ll get into the Spark SQL engi...Show More

What You'll Learn

Basics of Spark

Spark Architecture

Spark SQL

Spark DataFrames

Spark Datasets

What You'll Learn

Basics of Spark

Course Content

Spark Overview

Introduction

Spark Differentiation Architecture Spark Application Lifecycle Spark API Anatomy of a Spark Application Execution of a Spark Application Resilient Distributed Datasets Spark Application - An Example

DataFrames

DataFrames Working with DataFrames Columns

Rows More Operations with DataFrames

Datasets

Datasets Working with Datasets Datasets with Scala Case Class and Java Bean Class Encoders

Spark SQL

Spark SQL Engine Spark SQL - An Example Spark SQL Views and Tables Spark SQL Data Source Spark User Defined Functions Higher-Order Function

Joins, Unions, and Window Functions

Summary

Closing Remarks

Course Author

Trusted by 1.4 million developers working at companies

Anthony Walker

@_webarchitect_

Evan Dunbar

ML Engineer

Carlos Matias La Borde

Software Developer

Souvik Kundu

Front-end Developer

Vinay Krishnaiah

Software Developer

Eric Downs

Musician/Entrepeneur

Kenan Eyvazov

DevOps Engineer

Souvik Kundu

Front-end Developer

Eric Downs

Musician/Entrepeneur

Anthony Walker

@_webarchitect_

Evan Dunbar

ML Engineer

Hands-on Learning Powered by AI

See how Educative uses AI to make your learning more immersive than ever before.

Instant Code Feedback

Evaluate and debug your code with the click of a button. Get real-time feedback on test cases, including time and space complexity of your solutions.

AI-Powered Mock Interviews

Put your skills to the test in a simulated interview setting. Receive personalized feedback based on your performance. Available in Premium & Premium Plus plans.

Adaptive Learning

At various checkpoints throughout Educative courses, you will be prompted to take a quick assessment. Receive a condensed curriculum tailored to your strengths and skill gaps.

Explain with AI

Select any text within any Educative course, and get an instant explanation — without ever leaving your browser.

AI Code Mentor

AI Code Mentor helps you quickly identify errors in your code, learn from your mistakes, and nudge you in the right direction — just like a 1:1 tutor!

FOR TEAMS

Interested in this course for your business or team?

Unlock this course (and 1,000+ more) for your entire org with DevPath