Learn about the gradient descent algorithm and its application in logistic regression.
Logistic regression
Consider the scenario where we want to create a model that predicts whether an individual has diabetes or not. This is a case of binary classification and let’s assume that the input matrix X=⎣⎡x1Tx2T...xNT⎦⎤∈RN×d represents the collection of the d-dimensional input features, such as age, weight, height, cholesterol, etc., for N patients. Y=⎣⎡y1y2...yN⎦⎤∈{0,1}N denotes their corresponding binary labels (one means diabetes, and zero means no diabetes). The prediction Y^ of a logistic regression model is given as follows: