Uncertainty-Aware Variational-Recurrent Imputation Network for Clinical Time Series
Preprint
Abstract
Electronic health records (EHR) consist of longitudinal clinical observations portrayed with sparsity, irregularity, and high-dimensionality, which become major obstacles in drawing reliable downstream clinical outcomes. Although there exist great numbers of imputation methods to tackle these issues, most of them ignore correlated features, temporal dynamics and entirely set aside the uncertainty. Since the missing value estimates involve the risk of being inaccurate, it is appropriate for the method to handle the less certain information differently than the reliable data. In that regard, we can use the uncertainties in estimating the missing values as the fidelity score to be further utilized to alleviate the risk of biased missing value estimates. In this work, we propose a novel variational-recurrent imputation network, which unifies an imputation and a prediction network by taking into account the correlated features, temporal dynamics, as well as the uncertainty. Specifically, we leverage the deep generative model in the imputation, which is based on the distribution among variables, and a recurrent imputation network to exploit the temporal relations, in conjunction with utilization of the uncertainty. We validated the effectiveness of our proposed model on two publicly available real-world EHR datasets: PhysioNet Challenge 2012 and MIMIC-III, and compared the results with other competing state-of-the-art methods in the literature.Keywords
All Related Versions
This publication has 17 references indexed in Scilit:
- Handling incomplete heterogeneous data using VAEsPattern Recognition, 2020
- Benchmarking deep learning models on large healthcare datasetsJournal of Biomedical Informatics, 2018
- Recurrent Neural Networks for Multivariate Time Series with Missing ValuesScientific Reports, 2018
- Methods for interpreting and understanding deep neural networksDigital Signal Processing, 2018
- MIMIC-III, a freely accessible critical care databaseScientific Data, 2016
- Multiple imputation by chained equations: what is it and how does it work?International Journal of Methods in Psychiatric Research, 2011
- Multiple imputation using chained equations: Issues and guidance for practiceStatistics in Medicine, 2010
- The Treatment of Missing Values and its Effect on Classifier Accuracy2004
- A Bayesian missing value estimation method for gene expression profile dataBioinformatics, 2003
- Missing value estimation methods for DNA microarraysBioinformatics, 2001