Deep learning based decision tree ensembles for incomplete medical datasets
Authors:
- 5 January 2024
- journal article
- research article
- Published by SAGE Publications in Technology and Health Care
- Vol. 32 (1) , 75-87
Abstract
BACKGROUND: In practice, the collected datasets for data analysis are usually incomplete as some data contain missing attribute values. Many related works focus on constructing specific models to produce estimations to replace the missing values, to make the original incomplete datasets become complete. Another type of solution is to directly handle the incomplete datasets without missing value imputation, with decision trees being the major technique for this purpose. OBJECTIVE: To introduce a novel approach, namely Deep Learning-based Decision Tree Ensembles (DLDTE), which borrows the bounding box and sliding window strategies used in deep learning techniques to divide an incomplete dataset into a number of subsets and learning from each subset by a decision tree, resulting in decision tree ensembles. METHOD: Two medical domain problem datasets contain several hundred feature dimensions with the missing rates of 10% to 50% are used for performance comparison. RESULTS: The proposed DLDTE provides the highest rate of classification accuracy when compared with the baseline decision tree method, as well as two missing value imputation methods (mean and k-nearest neighbor), and the case deletion method. CONCLUSION: The results demonstrate the effectiveness of DLDTE for handling incomplete medical datasets with different missing rates.Keywords
This publication has 28 references indexed in Scilit:
- MissForest—non-parametric missing value imputation for mixed-type dataBioinformatics, 2011
- On the choice of the best imputation methods for missing values considering three groups of classification methodsKnowledge and Information Systems, 2011
- Pattern classification with missing data: a reviewNeural Computing and Applications, 2009
- AN EMPIRICAL COMPARISON OF TECHNIQUES FOR HANDLING INCOMPLETE DATA USING DECISION TREESApplied Artificial Intelligence, 2009
- Can k-NN imputation improve the performance of C4.5 with small software project data sets? A comparative evaluationJournal of Systems and Software, 2008
- Good methods for coping with missing data in decision treesPattern Recognition Letters, 2008
- Imputation of missing values is superior to complete case analysis and the missing-indicator method in multivariable diagnostic research: A clinical exampleJournal of Clinical Epidemiology, 2006
- A review of techniques for treating missing data in OM survey researchJournal of Operations Management, 2005
- The comparative efficacy of imputation methods for missing data in structural equation modelingEuropean Journal of Operational Research, 2003
- An analysis of four missing data treatment methods for supervised learningApplied Artificial Intelligence, 2003