Introduction to Model Optimization
This lesson will introduce the idea of model optimization.
Why is optimization hard?
The optimal value of one weight depends on the value of the other weights. Many weights are optimized at once. From the slope, we will understand which weights to increase or decrease. However, the updates may not improve the model meaningfully. This calls for changing the hyperparameters.
Get hands-on with 1400+ tech skills courses.