An Observed Value Consistent Diffusion Model for Imputing Missing Values in Multivariate Time Series
Open Access
- 4 August 2023
- conference paper
- Published by Association for Computing Machinery (ACM)
- p. 2409-2418
Abstract
Missing values, which are common in multivariate time series, is most important obstacle towards the utilization and interpretation of those data. Great efforts have been employed on how to accurately impute missing values in multivariate time series, and existing works either use deep learning networks to achieve deterministic imputations or aim at generating different plausible imputations by sampling multiple noises from a same distribution and then denoising them. However, these models either fall short of modeling the uncertainties of imputations due to their deterministic nature or perform poorly in terms of interpretability and imputation accuracy due to their ignorance of the correlations between the latent representations of both observed and missing values which are parts of samples from a same distribution. To this end, in this paper, we explicitly take the correlations between observed and missing values into account, and theoretically re-derive the Evidence Lower BOund (ELBO) of conditional diffusion model in the scenario of multivariate time series imputation. Based on the newly derived ELBO, we further propose a novel multivariate imputation diffusion model (MIDM) which is equipped with novel noise sampling, adding and denoising mechanisms for multivariate time series imputation, and the series of newly designed technologies jointly ensure the involving of the consistency between observed and missing values. Extensive experiments on both the tasks of multivariate time series imputation and forecasting witness the superiority of our proposed MIDM model on generating conditional estimations.Keywords
Funding Information
- Project of Stable Support for Youth Team in Basic Research Field, CAS (No.YSBR-005)
- National Natural Science Foundation of China (No.62072427, No.12227901)
This publication has 11 references indexed in Scilit:
- Inferring Intersection Traffic Patterns With Sparse Video Surveillance Information: An ST-GAN MethodIEEE Transactions on Vehicular Technology, 2022
- GLIMA: Global and Local Time Series Imputation with Multi-directional Attention Learning2020
- GMAN: A Graph Multi-Attention Network for Traffic PredictionProceedings of the AAAI Conference on Artificial Intelligence, 2020
- E²GAN: End-to-End Generative Adversarial Network for Multivariate Time Series Imputation2019
- Estimating Missing Data in Temporal Data Streams Using Multi-Directional Recurrent Neural NetworksIEEE Transactions on Biomedical Engineering, 2018
- Forecasting Fine-Grained Air Quality Based on Big Data2015
- Gaussian processes for time-series modellingPhilosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences, 2013
- mice: Multivariate Imputation by Chained Equations inRJournal of Statistical Software, 2011
- Nearest neighbor imputation of species-level, plot-scale forest structure attributes from LiDAR dataRemote Sensing of Environment, 2008
- Freeway Performance Measurement System: Mining Loop Detector DataTransportation Research Record: Journal of the Transportation Research Board, 2001