Creating Parameters

Tensors requiring gradients

What distinguishes a tensor used for training data from a tensor used as a trainable parameter/weight?

The latter requires the computation of its gradients, so we can update their values (the parameters’ values, that is). That is what the requires_grad=True argument is good for. It tells PyTorch to compute gradients for us.