...

/

Effect of Feature Scaling

Effect of Feature Scaling

Scale the features for model training.

If we recall the theory of KNN, it is a distance-based algorithm, and feature scaling is an important step that we intentionally skipped. Let’s see if we can improve the model performance with feature scaling.

Effect of feature scaling on KNN

KNN makes decisions by identifying the votes from the training data points nearest to the test data point (majority voting based on the k value). In such a situation, the scale of the features does matter. Variables with a larger scale will ...