Optimisation Function

Learn about different types of optimisation functions: what they are, their benefits and drawbacks?

We can also refine the technique that uses the back propagated gradients to update the network weights.

Stochastic gradient descent

Previously we used a fairly simple method, stochastic gradient descent. The method is popular because it is simple and fairly lightweight in terms of computer resources.

Get hands-on with 1300+ tech skills courses.