Normalisation

Learn about normalisation: what it is and why it is necessary?

We'll cover the following...

Why normalisation?

The weights in a neural network, and the signals that pass through a network, can have potentially large values. We’ve already seen how this can lead to saturation, which can make learning harder.

A lot of research has been done on the benefits of reducing the range of parameter and signal values in a neural network, and also shifting the values so the mean is zero. This is called ...