Limitations of Gradient Descent
Learn about the limitations of the gradient descent algorithms in non-convex optimization.
We have seen how well gradient descent works in the case of convex optimization because of the presence of a single global optimal solution. We will now look at some of the limitations of gradient descent and address them in this chapter.
Intractability
Consider a machine learning problem where we want to minimize the discrepancy between the model prediction
Get hands-on with 1400+ tech skills courses.