Integrating SMOTE-Tomek and Fusion Learning with XGBoost Meta-Learner for Robust Diabetes Recognition
Open Access
- 23 May 2024
- journal article
- research article
- Published by IntSys Research in Journal of Future Artificial Intelligence and Technologies
- Vol. 1 (1) , 23-38
Abstract
This research aims to develop a robust diabetes classification method by integrating the Synthetic Minority Over-sampling Technique (SMOTE)-Tomek technique for data balancing and using a machine learning ensemble led by eXtreme Gradient Boosting (XGB) as a meta-learner. We propose an ensemble model that combines deep learning techniques such as Bidirectional Long Short-Term Memory (BiLSTM) and Bidirectional Gated Recurrent Units (BiGRU) with XGB classifier as the base learner. The data used included the Pima Indians Diabetes and Iraqi Society Diabetes datasets, which were processed by missing value handling, duplication, normalization, and the application of SMOTE-Tomek to resolve data imbalances. XGB, as a meta-learner, successfully improves the model's predictive ability by reducing bias and variance, resulting in more accurate and robust classification. The proposed ensemble model achieves perfect accuracy, precision, recall, specificity, and F1 score of 100% on all tested datasets. This method shows that combining ensemble learning techniques with a rigorous preprocessing approach can significantly improve diabetes classification performance.Keywords
This publication has 35 references indexed in Scilit:
- Rice disease identification method based on improved CNN-BiGRUArtificial Intelligence in Agriculture, 2023
- A machine learning-based diagnosis modelling of type 2 diabetes mellitus with environmental metal exposureComputer Methods and Programs in Biomedicine, 2023
- An automated patient-specific ECG beat classification using LSTM-based recurrent neural networksBiomedical Signal Processing and Control, 2023
- KFPredict: An ensemble learning prediction framework for diabetes based on fusion of key featuresComputer Methods and Programs in Biomedicine, 2023
- Diabetes mellitus prediction and diagnosis from a data preprocessing and machine learning perspectiveComputer Methods and Programs in Biomedicine, 2022
- Pima Indians diabetes mellitus classification based on machine learning (ML) algorithmsNeural Computing and Applications, 2022
- Deep learning approach for diabetes prediction using PIMA Indian datasetJournal of Diabetes & Metabolic Disorders, 2020
- Diagnosis of diabetes mellitus using artificial neural network and classification and regression tree optimized with genetic algorithmJournal of Forecasting, 2020
- Diabetes prediction using artificial neural network2020
- Boosted neural network ensemble classification for lung cancer disease diagnosisApplied Soft Computing, 2019