Hyperparameters and Their Tuning

Let’s talk about hyperparameters and their tuning. A parameter is called a hyperparameter if its value is set before we start the training process of our model. Tuning is simply finding the best set of these parameters. Hyperparameters are not directly learned within the models. However, the values of other parameters are derived via training the model.