MSMOTE: Improving Classification Performance When Training Data is Imbalanced
Authors:
- Shengguo HuSHShengguo Hu
- Yanfeng LiangYLYanfeng Liang
- Lintao MaLMLintao Ma
- Ying HeYHYing He
- 1 January 2009
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- Vol. 2, 13-17
Abstract
Learning from data sets that contain very few instances of the minority class usually produces biased classifiers that have a higher predictive accuracy over the majority class, but poorer predictive accuracy over the minority class. SMOTE (synthetic minority over-sampling technique) is specifically designed for learning from imbalanced data sets. This paper presents a modified approach (MSMOTE) for learning from imbalanced data sets, based on the SMOTE algorithm. MSMOTE not only considers the distribution of minority class samples, but also eliminates noise samples by adaptive mediation. The combination of MSMOTE and AdaBoost are applied to several highly and moderately imbalanced data sets. The experimental results show that the prediction performance of MSMOTE is better than SMOTEBoost in the minority class and F-values are also improved.Keywords
This publication has 4 references indexed in Scilit:
- Training cost-sensitive neural networks with methods addressing the class imbalance problemIEEE Transactions on Knowledge and Data Engineering, 2005
- Evaluating boosting algorithms to classify rare classes: comparison and improvements2002
- SMOTE: Synthetic Minority Over-sampling TechniqueJournal of Artificial Intelligence Research, 2002
- The relationship between Recall and PrecisionJournal of the American Society for Information Science, 1994