Real-Time Imputation Model for Missing Sensor Data Based on Alternating Attention Mechanism
- 23 December 2024
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Sensors Journal
- Vol. 25 (5) , 8962-8974
Abstract
In fields like healthcare and finance, Multivariate Time Series(MTS) data frequently encounter a growing number and complexity of missing values, hindering the application of advanced analytical methods. Effective imputation of missing sensor data is essential for accurate data analysis. In the MTS, the variable changing with time create the time dependence, and the variables at each moment have a coupling relationship and influenced each other. At the same time, the missing series has the similar representation ability with the complete series. Based on these time series characteristics, this paper establishes a MTS imputation model based on the attention mechanism and contrastive learning. The attention model is used to deeply extract the temporal dependencies as well as the dependencies among the variables, while the contrastive learning is employed to ensure that missing series share similar feature representations with the original series, thereby enhancing the model’s imputation performance for incomplete series. Finally, after conducting extensive experiments on two real-world MTS datasets that contain five missing patterns, and when compared to state-of-the-art (SOTA) methods, the model performed well, with thirteen metrics achieving first place. Our method aims to provide a better database for the tasks such as anomaly detection, classification, and prediction of MTS.Keywords
Funding Information
- Hainan Seed Industry Laboratory (B23H10004)
- Key Research and Development Plan of the Ministry of Science and Technology (2022YFD2001700)
This publication has 26 references indexed in Scilit:
- Multi-task self-supervised time-series representation learningInformation Sciences, 2024
- Contextual Dependency Vision Transformer for spectrogram-based multivariate time series analysisNeurocomputing, 2023
- Energy forecasting with robust, flexible, and explainable machine learning algorithmsAI Magazine, 2023
- NRTSI: Non-Recurrent Time Series Imputation2023
- SAITS: Self-attention-based imputation for time seriesExpert Systems with Applications, 2023
- Temporal knowledge completion with context-aware embeddingsWorld Wide Web, 2021
- Contrastive Representation Learning: A Framework and ReviewIEEE Access, 2020
- Recurrent Neural Networks for Multivariate Time Series with Missing ValuesScientific Reports, 2018
- Missing data imputation using fuzzy-rough methodsNeurocomputing, 2016
- Combining neural networks and ARIMA models for hourly temperature forecast2000