Multi-objective ensemble deep learning using electronic health records to predict outcomes after lung cancer radiotherapy
- 13 December 2019
- journal article
- research article
- Published by IOP Publishing in Physics in Medicine & Biology
- Vol. 64 (24) , 245005
Abstract
Accurately predicting treatment outcome is crucial for creating personalized treatment plans and follow-up schedules. Electronic health records (EHRs) contain valuable patient-specific information that can be leveraged to improve outcome prediction. We propose a reliable multi-objective ensemble deep learning (MoEDL) method that uses features extracted from EHRs to predict high risk of treatment failure after radiotherapy in patients with lung cancer. The dataset used in this study contains EHRs of 814 patients who had not achieved disease-free status and 193 patients who were disease-free with at least one year follow-up time after lung cancer radiation therapy. The proposed MoEDL consists of three phases: (1) training with dynamic ensemble deep learning; (2) model selection with adaptive multi-objective optimization; and (3) testing with evidential reasoning (ER) fusion. Specifically, in the training phase, we employ deep perceptron networks as base learners to handle various issues with EHR data. The architecture and key hyper-parameters of each base learner are dynamically adjusted to increase the diversity of learners while reducing the time spent tuning hyper-parameters. Furthermore, we integrate the snapshot ensembles (SE) restarting strategy, multi-objective optimization, and ER fusion to improve the prediction robustness and accuracy of individual networks. The SE restarting strategy can yield multiple candidate models at no additional training cost in the training stage. The multi-objective model simultaneously considers sensitivity, specificity, and AUC as objective functions, overcoming the limitations of single-objective–based model selection. For the testing stage, we utilized an analytic ER rule to fuse the output scores from each optimal model to obtain reliable and robust predictive results. Our experimental results demonstrate that MoEDL can perform better than other conventional methods.Keywords
Funding Information
- National Institutes of Health (R01 EB020366)
This publication has 27 references indexed in Scilit:
- Deep Computational Phenotyping2015
- Deep learningNature, 2015
- Learning vector representation of medical objects via EMR-driven nonnegative restricted Boltzmann machines (eNRBM)Journal of Biomedical Informatics, 2015
- Uses of Electronic Health Records for Public Health Surveillance to Advance Public HealthAnnual Review of Public Health, 2015
- Identifying informative risk factors and predicting bone disease progression via deep belief networksMethods, 2014
- Strategies for Handling Missing Data in Electronic Health Record Derived DataeGEMs (Generating Evidence & Methods to improve patient outcomes), 2013
- LIBSVMACM Transactions on Intelligent Systems and Technology, 2011
- Multiple imputation by chained equations: what is it and how does it work?International Journal of Methods in Psychiatric Research, 2011
- AUC: a misleading measure of the performance of predictive distribution modelsGlobal Ecology and Biogeography, 2007
- A fast and elitist multiobjective genetic algorithm: NSGA-IIIEEE Transactions on Evolutionary Computation, 2002