Bias-Variance Trade-off
Understand the bias-variance trade-offs by visualizing the models and curating a table of symptoms and remedies.
The following illustration is the plot on model complexity and bias-variance trade-off.
Observe the curves to predict morale. Using a linear approach, our assumptions put us somewhere on this plot’s left side. We have a high bias, a low variance, and an oversimplified model with very low complexity. We don’t want this and should always look for the optimal point.
Increasing complexity
If we use the true function to predict morale, it increases, decreases, and increases again, but we are just predicting the morale linearly with days (time). We need to increase the complexity of our model because modeling with a linear effect of days or time alone can’t fit a good curve. While creating the model for morale predictions, we have only one ...