REVISITING DISTANCE METRICS IN k-NEAREST NEIGHBORS ALGORITHMS Implications for Sovereign Country Credit Rating Assessments

Abstract

The k-nearest neighbors (k-NN) algorithm, a fundamental machine learning technique, typically employs the Euclidean distance metric for proximity-based data classification. This research focuses on the feature importance infused k-NN model, an advanced form of k-NN. Diverging from traditional algorithm uniform weighted Euclidean distance, feature importance infused k-NN introduces a specialized distance weighting system. This system emphasizes critical features while reducing the impact of lesser ones, thereby enhancing classification accuracy. Empirical studies indicate a 1.7% average accuracy improvement with proposed model over conventional model, attributed to its effective handling of feature importance in distance calculations. Notably, a significant positive correlation was observed between the disparity in feature importance levels and the model’s accuracy, highlighting proposed model’s proficiency in handling variables with limited explanatory power. These findings suggest proposed model’s potential and open avenues for future research, particularly in refining its feature importance weighting mechanism, broadening dataset applicability, and examining its compatibility with different distance metrics.