Low-Rank and Deep Plug-and-Play Priors for Missing Traffic Data Imputation
- 18 November 2024
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Intelligent Transportation Systems
- Vol. 26 (2) , 2690-2706
Abstract
The development of sensor technology has resulted in the accumulation of extensive spatiotemporal traffic information, which holds great potential for predicting traffic patterns and improving traffic management strategies. Nevertheless, dealing with missing data poses a significant challenge for the intelligent traffic system (ITS). To address this issue, this study employs a nonconvex smoothly clipped absolute deviation (SCAD) penalty customized for tensors to surrogate tensor rank and incorporates the deep plug-and-play (PnP) prior into the low-rank tensor completion (LRTC) model. An efficient iterative framework is formulated to integrate these penalties into the alternating direction method of multipliers (ADMM) method. Moreover, two imputation methods, namely LRTC-SCAD and LRTC-SCAD-DeepPnP, are developed, affirming that the LRTC-SCAD method ensures convergence to the global optimum. We conduct simulated experiments using real-world traffic datasets, and our proposed methods outperform state-of-the-art imputation methods. For instance, on the Portland dataset, LRTC-SCAD achieves a noteworthy 9.86% improvement in mean absolute percentage error (MAPE) compared to the cutting-edge LRTC method while consuming only 28.26% of its total running time. Similarly, on the PeMS dataset, LRTC-SCAD-DeepPnP achieves an average 11.59% enhancement in MAPE, with visually compelling improvements in imputation results, further validating its efficacy in maintaining local consistency. The code is available at https://github.com/peterchen96/LRTC_DeepPnP.Keywords
Funding Information
- National Key Research and Development Program of China (2021YFA1000300, 2021YFA1000302)
- Fundamental Research Funds for the Central Universities
- Natural Science Foundation of Shanghai Municipality (22ZR1419500)
- Science and Technology Commission of Shanghai Municipality (22DZ2229014)
This publication has 66 references indexed in Scilit:
- Hierarchical spatio-temporal graph convolutional neural networks for traffic data imputationInformation Fusion, 2024
- Semantic understanding and prompt engineering for large-scale traffic data imputationInformation Fusion, 2023
- Tensor completion by multi-rank via unitary transformationApplied and Computational Harmonic Analysis, 2023
- Patch-based weighted SCAD prior for compressive sensingInformation Sciences, 2022
- A tensor train approach for internet traffic data completionAnnals of Operations Research, 2021
- Robust Schatten-p Norm Based Approach for Tensor CompletionJournal of Scientific Computing, 2020
- Global Convergence of ADMM in Nonconvex Nonsmooth OptimizationJournal of Scientific Computing, 2018
- Human motion recovery utilizing truncated schatten p -norm and kinematic constraintsInformation Sciences, 2018
- Towards a standardized notation and terminology in multiway analysisJournal of Chemometrics, 2000
- A trace inequality of John von NeumannMonatshefte für Mathematik, 1975