CS-MLAkNN: A Cost-Sensitive Adaptive k-Nearest Neighbors Algorithm for Imbalanced Multi-Label Learning
Open Access
Abstract
Multi-label data usually carries a complex structural class imbalance, which significantly affects the overall predictive performance of multi-label learning models. Although many studies have investigated this problem, most existing methods rely on resampling, static cost weighting, or ensemble learning. Few studies simultaneously consider cost information and neighborhood size within the local statistical model of ML-kNN. To address this issue, this paper proposes a cost-sensitive adaptive k-nearest neighbors algorithm, named CS-MLAkNN, for imbalanced multi-label learning. The algorithm implements a dual cost-sensitive strategy at both the feature and label levels within the ML-kNN framework. Specifically, feature-level cost sensitivity is achieved through distance weighting during the training phase. In the prediction phase, label distribution information is incorporated into the posterior probability calculation to achieve label-level cost sensitivity. Moreover, the optimal number of neighbors (k) is determined adaptively through cross-validation. CS-MLAkNN maintains the simplicity and interpretability of the original ML-kNN, and meanwhile it explicitly introduces cost sensitivity and adaptiveness into three key steps: distance metric, posterior decision, and neighbor determination. Experimental results on 14 benchmark datasets demonstrate that the proposed method achieves optimal or near-optimal performance across various evaluation metrics. It also shows significant advantages over other state-of-the-art imbalanced multi-label learning algorithms.Keywords
Funding Information
- National Natural Science Foundation of China (62176107)
This publication has 38 references indexed in Scilit:
- ECC + +: An algorithm family based on ensemble of classifier chains for classifying imbalanced multi-label dataExpert Systems with Applications, 2023
- Supervised learningAmerican Journal of Orthodontics and Dentofacial Orthopedics, 2023
- Cross validation for model selection: A review with examples from ecologyEcological Monographs, 2023
- Confidence interval for micro-averaged F1 and macro-averaged F1 scoresApplied Intelligence, 2021
- Feature weighting to tackle label dependencies in multi-label stacking nearest neighborApplied Intelligence, 2021
- Adaptive Decision Threshold-Based Extreme Learning Machine for Classifying Imbalanced Multi-label DataNeural Processing Letters, 2020
- A survey on ensemble learningFrontiers of Computer Science, 2019
- Survey on supervised machine learning techniques for automatic text classificationArtificial Intelligence Review, 2019
- Binary relevance for multi-label learning: an overviewFrontiers of Computer Science, 2017
- Progressive random k-labelsets for cost-sensitive multi-label classificationMachine Learning, 2016