Combination of PCA with SMOTE Oversampling for Classification of High-Dimensional Imbalanced Data
- 17 September 2021
- journal article
- research article
- Published by Bitlis Eren Universitesi Fen Bilimleri Dergisi in Bitlis Eren Üniversitesi Fen Bilimleri Dergisi
- Vol. 10 (3) , 858-869
Abstract
Imbalanced data classification is a common issue in data mining where the classifiers are skewed towards the larger data class. Classification of high-dimensional skewed (imbalanced) data is of great interest to decision-makers as it is more difficult to. The dimension reduction method, a process in which variables are reduced, allows high dimensional datasets to be interpreted more easily with a certain loss. This study, a method combining SMOTE oversampling with principal component analysis is proposed to solve the imbalance problem in high dimensional data. Three classification algorithms consisting of Logistic Regression, K-Nearest Neighbor, Decision Tree methods and two separate datasets were utilized to evaluate the suggested method's efficacy and determine the classifiers' performance. Respectively, raw datasets, converted datasets by PCA, SMOTE and SMOTE+PCA (SMOTE and PCA) methods, were analyzed with the given algorithms. Analyzes were made using WEKA. Analysis results suggest that almost all classification algorithms improve their classification performance using PCA, SOMTE, and SMOTE+PCA methods. However, the SMOTE method gave more efficient results than PCA and PCA+SMOTE methods for data rebalancing. Experimental results also suggest that K-Nearest Neighbor classifier provided higher classification performance compared to other algorithms.Keywords
This publication has 19 references indexed in Scilit:
- Diagnosis of Diabetes Using Classification Mining TechniquesInternational Journal of Data Mining & Knowledge Management Process, 2015
- Survey on Anomaly Detection using Data Mining TechniquesProcedia Computer Science, 2015
- k-Nearest Neighbor Classification over Semantically Secure Encrypted Relational DataIEEE Transactions on Knowledge and Data Engineering, 2014
- An Analysis of students’ performance using classification algorithmsIOSR Journal of Computer Engineering, 2014
- Combination of PCA with SMOTE Resampling to Boost the Prediction Rate in Lung Cancer DatasetInternational Journal of Computer Applications, 2013
- The WEKA data mining softwareACM SIGKDD Explorations Newsletter, 2009
- CLASSIFICATION OF IMBALANCED DATA: A REVIEWInternational Journal of Pattern Recognition and Artificial Intelligence, 2009
- An Introduction to Logistic Regression Analysis and ReportingThe Journal of Educational Research, 2002
- Machine learning and data miningCommunications of the ACM, 1999
- Dimension Reduction by Local Principal Component AnalysisNeural Computation, 1997