The KNN algorithm is a straightforward machine learning algorithm used for both regression. It operates on the principle of proximity between data points. To predict a new data point, the KNN algorithm identifies its k nearest neighbors in the training dataset. The label of the new data point is then determined based on the majority class among its