Normalisation
Learn about normalisation: what it is and why it is necessary?
We'll cover the following...
Why normalisation?
The weights in a neural network, and the signals that pass through a network, can have potentially large values. We’ve already seen how this can lead to saturation, which can make learning harder.
A lot of research has been done on the benefits of reducing the range of parameter and signal values in a neural network, and also shifting the values so the mean is zero. This is called ...