Home>Courses>Deep Learning with PyTorch Step-by-Step: Part I - Fundamentals

Deep Learning with PyTorch Step-by-Step: Part I - Fundamentals

Delve into PyTorch basics: autograd, model classes, datasets, and data loaders. Gain insights into model development while avoiding common pitfalls. Start creating and training your own PyTorch models.

Beginner

92 Lessons

Certificate of Completion

AI-POWERED

Explanations

AI-POWERED

Explanations

This course includes

184 Playgrounds

20 Quizzes

Course Overview

Course Content

Apply Your Skills

Course Overview

This course is designed to provide you with an easy-to-follow, structured, incremental, and from-first-principles approach to learning PyTorch. In this course, you’ll be introduced to the fundamentals of PyTorch: autograd, model classes, datasets, data loaders, and more. You will develop, step-by-step, not only the models themselves but also your understanding of them. You'll be shown both the reasoning behind the code and how to avoid some common pitfalls and errors along the way. By the time you finish th...Show More

Course Content

Introduction

2 Lessons

Get familiar with PyTorch's pythonic nature and foundational concepts designed for beginners.

Why PyTorch?

Course Overview

Visualizing Gradient Descent

15 Lessons

Unpack the core of visualizing gradient descent, exploring parameter updates, learning rates, and feature scaling using a linear regression model in Numpy.

Spoilers

Gradient Descent

Data Generation

Basic Steps for Using Gradient Descent (Step 0 and 1)

Step 2a - Compute the Loss

Step 2b - Computing the Loss Surface

Step 3 - Compute the Gradients

Step 4 - Update the Parameters

Learning Rate

Scaling the Dataset

Step 5 - Rinse and Repeat!

Recap

Quiz

Challenge 1 - Visualizing Gradient Descent

Solution Review - Visualizing Gradient Descent

A Simple Regression Problem

21 Lessons

Master the steps to implement linear regression with PyTorch, covering tensors, autograd, optimizers, and model creation.

Spoilers

Reviewing the Steps of Gradient Descent

Linear Regression in Numpy

PyTorch Tensors

Loading Data, Devices, and CUDA

Dynamic Computation Graphs

Putting It All Together

Recap

Quiz

Challenge 2 - A Simple Regression Problem

Solution Review: A Simple Regression Problem

Rethinking the Training Loop

17 Lessons

Grasp the fundamentals of creating an effective training loop in PyTorch.

Spoilers

Introducing Higher-Order Functions

Rethinking the Training Loop

Building a Dataset

DataLoader

Quiz

Mini-Batch Inner Loop and Training Split

Evaluation

TensorBoard

SummaryWriter

Saving and Loading Models

Deploying / Making Predictions

Putting It All Together

Recap

Quiz

Challenge 3 - Rethinking the Training Loop

Solution Review - Rethinking the Training Loop

Going Classy

15 Lessons

Deepen your knowledge of creating and integrating a PyTorch class, enhancing code management.

Spoilers

Going Classy

Functions

Different Method Types

Training Methods

Saving and Loading Methods

Finalising the Methods needed for going Classy

Classy Pipeline

Model Training and Predictions

Checkpointing

Putting It All Together

Recap

Quiz

Challenge 4 - Going Classy

Solution Review - Going Classy

A Simple Classification Problem

19 Lessons

See how it works to build and evaluate a binary classification model using PyTorch.

Spoilers

Classification Problems

Model for Classification Problems

Sigmoid and Logistic Regression

Quiz

Loss

Binary Cross-Entropy Loss in PyTorch

Imbalanced Dataset

Model Configuration, Training, and Predictions for Classification

Decision Boundary

Classification Threshold and Confusion Matrix

Metrics

Trade-offs and Curves

Best + Worst Curves and Models

Putting it All Together

Recap

Quiz

Challenge 5 - A Simple Classification Problem

Solution Review: A Simple Classification Problem

Conclusion

1 Lessons

Build on your deep learning skills by exploring further and staying engaged.

What's Next?

Appendix

2 Lessons

Get familiar with setting up Jupyter notebooks and running TensorBoard for deep learning tasks.

Course Author

Text Summarization with Transformers

intermediate

1 hour

Project

Text Summarization with Transformers

Learn to summarize text using the BART transformer model, focusing on pre-training techniques and evaluation methods.

intermediate

1 hour

Project

Using a PyTorch Model in JavaScript with ONNX

intermediate

1 hour

Project

Using a PyTorch Model in JavaScript with ONNX

Learn to convert a PyTorch ResNet-18 model to ONNX for use in JavaScript for image classification tasks.

intermediate

1 hour

Trusted by 2.5 million developers working at companies

"These are high-quality courses. Trust me. I own around 10 and the price is worth it for the content quality. EducativeInc came at the right time in my career. I'm understanding topics better than with any book or online video tutorial I've done. Truly made for developers. Thanks"

Anthony Walker

@_webarchitect_

"Just finished my first full #ML course: Machine learning for Software Engineers from Educative, Inc. ... Highly recommend!"

Evan Dunbar

ML Engineer

"You guys are the gold standard of crash-courses... Narrow enough that it doesn't need years of study or a full blown book to get the gist, but broad enough that an afternoon of Googling doesn't cut it."

Carlos Matias La Borde

Software Developer

"I spend my days and nights on Educative. It is indispensable. It is such a unique and reader-friendly site"

Souvik Kundu

Front-end Developer

"Your courses are simply awesome, the depth they go into and the breadth of coverage is so good that I don't have to refer to 10 different websites looking for interview topics and content."

Vinay Krishnaiah

Software Developer

"I've tried probably 5-7 different sites and Educative is easily the best. It perfectly blends explanation with interactivity"

Eric Downs

Musician/Entrepeneur

Hands-on Learning Powered by AI

See how Educative uses AI to make your learning more immersive than ever before.

Instant Code Feedback

Evaluate and debug your code with the click of a button. Get real-time feedback on test cases, including time and space complexity of your solutions.

AI-Powered Mock Interviews

Put your skills to the test in a simulated interview setting. Receive personalized feedback based on your performance. Available in Premium & Premium Plus plans.

Adaptive Learning

At various checkpoints throughout Educative courses, you will be prompted to take a quick assessment. Receive a condensed curriculum tailored to your strengths and skill gaps.

Explain with AI

Select any text within any Educative course, and get an instant explanation — without ever leaving your browser.

AI Code Mentor

AI Code Mentor helps you quickly identify errors in your code, learn from your mistakes, and nudge you in the right direction — just like a 1:1 tutor!

Free Resources

FOR TEAMS

Interested in this course for your business or team?

Unlock this course (and 1,000+ more) for your entire org with DevPath