Activation Functions
Learn about the most popular activation functions for deep learning.
We'll cover the following...
Activation functions are non-linear functions that determine the outputs of neurons. As we already discussed, each neuron accepts a set of inputs, multiplies them by the weights, sums them up, and adds a bias.
Because that will result in a linear transformation, we then pass neurons through a non-linear function so we can capture non-linear patterns between our data.
...