Method for Incomplete and Imbalanced Data Based on Multivariate Imputation by Chained Equations and Ensemble Learning
- 18 March 2024
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Journal of Biomedical and Health Informatics
- Vol. 28 (5) , 3102-3113
Abstract
The classification analysis of incomplete and imbalanced data is still a challenging task since these issues could negatively impact the training of classifiers, which were also found in our study on the physical fitness assessments of patients. And in fields such as healthcare, there are higher requirements for the accuracy of the generated imputation values. To train a high-performance classifier and pursue high accuracy, we attempted to resolve any potential negative impact by using a novel algorithmic approach based on the combination of multivariate imputation by chained equations and the ensemble learning method (MICEEN), which can solve the two problems simultaneously. We used multivariate imputation by chained equations to generate more accurate imputation values for the training set passed to ensemble learning to build a predictor. On the other hand, missing values were introduced into minority classes and used them to generate new samples belonging to the minority classes in order to balance the distribution of classes. On real-world datasets, we perform extensive experiments to assess our method and compare it to other state-of-the-art approaches. The advantages of the proposed method are demonstrated by experimental results for the benchmark datasets and self-collected datasets of physical fitness assessment of tumor patients with varying missing rates.Keywords
This publication has 42 references indexed in Scilit:
- MI-MOTE: Multiple imputation-based minority oversampling technique for imbalanced and incomplete data classificationInformation Sciences, 2021
- Imputation of missing data with class imbalance using conditional generative adversarial networksNeurocomputing, 2021
- Support vector regression‐based imputation in analogy‐based software development effort estimationJournal of Software: Evolution and Process, 2018
- Missing data in clinical trials: control‐based mean imputation and sensitivity analysisPharmaceutical Statistics, 2017
- Learning from class-imbalanced data: Review of methods and applicationsExpert Systems with Applications, 2017
- Teaching of Independent Exercises for Prehabilitation in Breast CancerJournal of Cancer Education, 2015
- Impact of preoperative change in physical function on postoperative recovery: Argument supporting prehabilitation for colorectal surgerySurgery, 2011
- Missing data imputation using statistical and machine learning methods in a real breast cancer problemArtificial Intelligence in Medicine, 2010
- Multiple imputation of missing blood pressure covariates in survival analysisStatistics in Medicine, 1999
- Adaptive rehabilitation of the cancer patientCurrent Problems in Cancer, 1980