Automatic Differentiation
Learn about automatic differentiation and how it can be programmed.
Programming derivatives
Calculating the gradients for a multilayer perceptron of simple sigmoid units has already been shown to be a bit cumbersome, so we might be worried about how more elaborate networks could be implemented.
Get hands-on with 1400+ tech skills courses.