Linear Regression and Gradient Descent

We have seen that writing machine learning programs is easy with high-level computer languages and with the help of good machine learning libraries. However, applying such algorithms with superior performance appropriately requires considerable experience and a deeper knowledge of the underlying ideas and algorithms. We will now take a step back to consider basic regression in more detail, which in turn will be the foundation for discussing probabilistic models in the next chapters. This chapter aims to discuss the basis of the learning algorithm through gradient descent.