Predictive Monitoring with Logic-Calibrated Uncertainty for Cyber-Physical Systems
Authors:
Open Access
- 22 September 2021
- journal article
- research article
- Published by Association for Computing Machinery (ACM) in ACM Transactions on Embedded Computing Systems
- Vol. 20 (5s) , 1-25
Abstract
Predictive monitoring—making predictions about future states and monitoring if the predicted states satisfy requirements—offers a promising paradigm in supporting the decision making of Cyber-Physical Systems (CPS). Existing works of predictive monitoring mostly focus on monitoring individual predictions rather than sequential predictions. We develop a novel approach for monitoring sequential predictions generated from Bayesian Recurrent Neural Networks (RNNs) that can capture the inherent uncertainty in CPS, drawing on insights from our study of real-world CPS datasets. We propose a new logic named Signal Temporal Logic with Uncertainty (STL-U) to monitor a flowpipe containing an infinite set of uncertain sequences predicted by Bayesian RNNs. We define STL-U strong and weak satisfaction semantics based on whether all or some sequences contained in a flowpipe satisfy the requirement. We also develop methods to compute the range of confidence levels under which a flowpipe is guaranteed to strongly (weakly) satisfy an STL-U formula. Furthermore, we develop novel criteria that leverage STL-U monitoring results to calibrate the uncertainty estimation in Bayesian RNNs. Finally, we evaluate the proposed approach via experiments with real-world CPS datasets and a simulated smart city case study, which show very encouraging results of STL-U based predictive monitoring approach outperforming baselines.Keywords
All Related Versions
Funding Information
- National Science Foundation (CCF-1942836, CNS-1952096)
- NRT (1829004)
- Austrian FFG-funded (IoT4CPS)
- WWTF (ICT19-018)
This publication has 27 references indexed in Scilit:
- Safe Autonomy Under Perception Uncertainty Using Chance-Constrained Temporal LogicJournal of Automated Reasoning, 2017
- STL Model Checking of Continuous and Hybrid Systems2016
- Safe Control under Uncertainty with Probabilistic Signal Temporal Logic2016
- SpaTeL2015
- Parameter Synthesis Through Temporal Logic Specifications2015
- Understanding review helpfulness as a function of reviewer reputation, review rating, and review depthJournal of the Association for Information Science and Technology, 2014
- Runtime Verification with Particle Filtering2013
- Runtime Verification with State Estimation2012
- Reasoning with Temporal Logic on Truncated Paths2003
- Keeping the neural networks simple by minimizing the description length of the weights1993