Reviewing the Steps of Gradient Descent

Simple linear regression

Most tutorials start with some nice and pretty image classification problems to illustrate how to use PyTorch. It may seem cool, but I believe it distracts you from learning how PyTorch works.

For this reason, in this first example, we will stick with a simple and familiar problem: a linear regression with a single feature x! It does not get much simpler than that. It has the following equation:

It is also possible to think of it as the simplest neural network possible: one input, one output, and no activation function (that is, linear).