A Deep Learning Based Data Recovery Approach for Missing and Erroneous Data of IoT Nodes
Open Access
Abstract
Internet of things (IoT) nodes are deployed in large-scale automated monitoring applications to capture the massive amount of data from various locations in a time-series manner. The captured data are affected due to several factors such as device malfunctioning, unstable communication, environmental factors, synchronization problem, and unreliable nodes, which results in data inconsistency. Data recovery approaches are one of the best solutions to reduce data inconsistency. This research provides a missing data recovery approach based on spatial-temporal (ST) correlation between the IoT nodes in the network. The proposed approach has a clustering phase (CL) and a data recovery (DR) phase. In the CL phase, the nodes can be clustered based on their spatial and temporal relationship, and common neighbors are extracted. In the DR phase, missing data can be recovered with the help of neighbor nodes using the ST-hierarchical long short-term memory (ST-HLSTM) algorithm. The proposed algorithm has been verified on real-world IoT-based hydraulic test rig data sets which are gathered from things speak real-time cloud platform. The algorithm shows approximately 98.5% reliability as compared with the other existing algorithms due to its spatial-temporal features based on deep neural network architecture.Keywords
This publication has 43 references indexed in Scilit:
- Handling missing data in multivariate time series using a vector autoregressive model based imputation (VAR-IM) algorithm: Part I: VAR-IM algorithm versus traditional methods2016
- Recover Corrupted Data in Sensor Networks: A Matrix Completion SolutionIEEE Transactions on Mobile Computing, 2016
- Data Recovery in Wireless Sensor Networks With Joint Matrix Completion and Sparsity ConstraintsIEEE Communications Letters, 2015
- Improving Power Grid Monitoring Data Quality: An Efficient Machine Learning Framework for Missing Data Prediction2015
- A Spatial Correlation Based Adaptive Missing Data Estimation Algorithm in Wireless Sensor NetworksInternational Journal of Wireless Information Networks, 2014
- A Vision of IoT: Applications, Challenges, and Opportunities With China PerspectiveIEEE Internet of Things Journal, 2014
- Hybrid speech recognition with Deep Bidirectional LSTM2013
- Data loss and reconstruction in sensor networks2013
- Tensor Completion for Estimating Missing Values in Visual DataIEEE Transactions on Pattern Analysis and Machine Intelligence, 2012
- MissForest—non-parametric missing value imputation for mixed-type dataBioinformatics, 2011