Improved Oversampling Algorithm for Imbalanced Data Based on K-Nearest Neighbor and Interpolation Process Optimization
Open Access
Abstract
The problems of imbalanced datasets are generally considered asymmetric issues. In asymmetric problems, artificial intelligence models may exhibit different biases or preferences when dealing with different classes. In the process of addressing class imbalance learning problems, the classification model will pay too much attention to the majority class samples and cannot guarantee the classification performance of the minority class samples, which might be more valuable. By synthesizing the minority class samples and changing the data distribution, unbalanced datasets can be optimized. Traditional oversampling algorithms have problems of blindness and boundary ambiguity when synthesizing new samples. A modified reclassification algorithm based on Gaussian distribution is put forward. First, the minority class samples are reclassified by the KNN algorithm. Then, different synthesis strategies are selected according to the combination of the minority class samples, and the Gaussian distribution is used to replace the uniform random distribution for interpolation operation under certain classification conditions to reduce the possibility of generating noise samples. The experimental results indicate that the proposed oversampling algorithm can achieve a performance improvement of 2∼ in evaluation metrics, including G-mean, F-measure, and AUC, compared to traditional oversampling algorithms.
Keywords
Funding Information
- China National Railway Group Co., Ltd. Technology Research and Development Program Project (N2022G048, 21210750300, 20090503100)
- Shanghai Science and Technology Commission—“Belt and Road” China-Laos Railway Project International Joint Laboratory (N2022G048, 21210750300, 20090503100)
- Shanghai Science and Technology Commission—Research on Key Technologies of Intelligent Operation and Maintenance of Rail Transit (N2022G048, 21210750300, 20090503100)
This publication has 25 references indexed in Scilit:
- Cost-sensitive incremental Classification under the MapReduce framework for Mining Imbalanced Massive Data StreamsJournal of Discrete Mathematical Sciences and Cryptography, 2015
- A new one-class SVM based on hidden informationKnowledge-Based Systems, 2014
- A hybrid text classification approach with low dependency on parameter by integrating K-nearest neighbor and support vector machineExpert Systems with Applications, 2012
- Knowledge discovery from imbalanced and noisy dataData & Knowledge Engineering, 2009
- Safe-Level-SMOTE: Safe-Level-Synthetic Minority Over-Sampling TEchnique for Handling the Class Imbalanced Problem2009
- Knowledge acquisition through information granulation for imbalanced dataExpert Systems with Applications, 2006
- Borderline-SMOTE: A New Over-Sampling Method in Imbalanced Data Sets Learning2005
- Support-vector networksMachine Learning, 1995
- Principal component analysis in linear systems: Controllability, observability, and model reductionIEEE Transactions on Automatic Control, 1981
- Nearest neighbor pattern classificationIEEE Transactions on Information Theory, 1967