...
/Model for Classification Problems
Model for Classification Problems
We'll cover the following...
Model
Given a classification problem, one of the most straightforward models is logistic regression. But, instead of simply presenting it and using it right away, we are going to build up to it. The rationale behind this approach is twofold. First, it will clarify why this algorithm is called logistic regression if it is used for classification. Second, you will have a clear understanding of what a logit is.
Linear regression
Well, since it is called “logistic regression,” then linear regression is a good starting point for us to build up to it. What would a linear regression model with two features look like?
There is one obvious problem with the model above. Our labels (y
) are discrete, meaning they can be only zero or one. We need to change the model slightly to adapt it to our purposes.
“What if we assign the positive outputs to one and the negative outputs to zero?”
Makes sense, right? We are already calling them positive and negative classes anyway. Why not put their names to good use? Our model would look like this:
...