Step 3 - Compute the Gradients
Learn about gradients and how they can be computed and visualized.
We'll cover the following
Introduction to gradients
A gradient is a partial derivative; why partial? Because one computes it with respect to (w.r.t.) a single parameter. Since we have two parameters, b
and w
, we must compute two partial derivatives.
A derivative tells you how much a given quantity changes when you slightly vary some other quantity. In our case, how much does our MSE loss change when we vary each one of our two parameters separately?
Get hands-on with 1400+ tech skills courses.