Machine Learning Algorithms II
6. K-Nearest Neighbors (KNN)
KNN algorithm is a very simple and popular technique. It is based on the following idea from real life: You are the average of the five people you most associate with!
KNN classifies an object by searching through the entire training set for the k most similar instances, the k neighbors, and assigning a common output variable to all those k instances. The figure below represents a classification example. The test sample (green dot) should be classified either to blue squares or to red triangles. If k = 3 (solid line circle) it is assigned to the red triangles because there are 2 triangles and only 1 square inside the inner circle. If k = 5 (dashed line circle) it is assigned to the blue squares (3 squares vs. 2 triangles inside the outer circle):
Get hands-on with 1400+ tech skills courses.