Recap

General overview

This finishes our journey through the inner workings of gradient descent. By now, we hope you are able to develop better intuition about the many different aspects involved in the process.

In time and with practice, you will observe the behaviors described here in your own models. Make sure to try plenty of different combinations: mini-batch sizes, learning rates, etc. This way, not only your models will learn but so will you!