QUANTUM-ASSISTED FEATURE SELECTION FOR IMPROVING PREDICTION MODEL ACCURACY ON LARGE AND IMBALANCED DATASETS
Open Access
- 27 November 2025
- journal article
- Published by LPPM Universitas Nusa Mandiri in JITK (Jurnal Ilmu Pengetahuan dan Teknologi Komputer)
- Vol. 11 (2) , 520-527
Abstract
One of the biggest obstacles to creating precise machine learning models is choosing representative and pertinent characteristics from big, unbalanced datasets. While too many features raise the risk of overfitting and computational expense, class imbalance frequently results in decreased accuracy and bias. The Simulated Annealing technique is used in this study to tackle a Quadratic Unconstrained Binary Optimization (QUBO) problem that is formulated as a quantum-assisted feature selection method to handle these problems. The technique seeks to reduce inter-feature redundancy and the number of selected features. There are 102,487 samples in the majority class and 11,239 in the minority class, totaling 28 characteristics in the experimental dataset. Nine ideal features were found during the feature selection method (12, 14, 15, 22, 23, 24, 25, 27, and 28). Ten-fold cross-validation was used to assess a Random Forest Classifier that was trained using an 80:20 split. With precision, recall, f1-score, and accuracy all hitting 1.00, the suggested QUBO+SMOTE method demonstrated exceptional performance. Comparatively, QUBO without SMOTE performed worse with accuracy 0.95 and minority-class f1-score of only 0.71, whereas a traditional Recursive Feature Elimination (RFE) approach obtained accuracy 0.97 with minority-class f1-score of 0.94. These findings indicate that QUBO can reduce dimensionality and address class imbalance which requires its integration with SMOTE. This study demonstrates how quantum computing can enhance the effectiveness and efficiency of machine learning, especially for large-scale imbalanced datasetsKeywords
This publication has 19 references indexed in Scilit:
- Quantum annealing for combinatorial optimization: a benchmarking studynpj Quantum Information, 2025
- Review of Methods for Handling Class Imbalance in Classification Problems2024
- Metaheuristic optimization algorithms for real-world electrical and civil engineering application: A reviewResults in Engineering, 2024
- A review of ensemble learning and data augmentation models for class imbalanced problems: Combination, implementation and evaluationExpert Systems with Applications, 2023
- Predicting vehicle prices via quantum-assisted feature selectionInternational Journal of Information Technology, 2023
- An exhaustive review of the metaheuristic algorithms for search and optimization: taxonomy, applications, and open challengesArtificial Intelligence Review, 2023
- Feature selection on quantum computersQuantum Machine Intelligence, 2023
- A theoretical distribution analysis of synthetic minority oversampling technique (SMOTE) for imbalanced learningMachine Learning, 2023
- A review of swarm-based metaheuristic optimization techniques and their application to doubly fed induction generatorHeliyon, 2022
- An extension of Synthetic Minority Oversampling Technique based on Kalman filter for imbalanced datasetsMachine Learning with Applications, 2022