Diagnosing Violations of State-Based Specifications in iCFTL
Open Access
- 24 February 2026
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Software Engineering
- Vol. 52 (4) , 1495-1514
Abstract
As modern software systems grow in complexity and operate in dynamic environments, the need for runtime analysis techniques becomes a more critical part of the verification and validation process. Runtime verification monitors the runtime system behaviour by checking whether an execution trace— a sequence of recorded events—satisfies a given specification, yielding a Boolean or quantitative verdict. However, when a specification is violated, such a verdict is often insufficient to understand why the violation happened. To fill this gap, diagnostics approaches aim to produce more informative verdicts. In this paper, we address the problem of generating informative verdicts for violated Inter-procedural Control-Flow Temporal Logic (iCFTL) specifications that express constraints over program variable values. We propose a diagnostic approach based on backward data-flow analysis to statically determine the relevant statements contributing to the specification violation. Using this analysis, we instrument the program to produce enriched execution traces. Using the enriched execution traces, we perform the runtime analysis and identify the statements whose execution led to the specification violation. We implemented our approach in a prototype tool, iCFTLdiagnostics, and evaluated it on 112 specifications across 10 software projects. Our tool achieves 90% precision in identifying relevant statements for 100 of the 112 specifications. It reduces the number of lines that have to be inspected for diagnosing a violation by at least 90%. In terms of computational cost, our experiments show that iCFTLdiagnostics generates a diagnosis within 7 min, and requires no more than 25MB of memory. The instrumentation required to support diagnostics incurs an execution time overhead of less than 30% and a memory overhead below 20%.Keywords
All Related Versions
Funding Information
- Luxembourg National Research Fund (17065054)
- European Union’s Horizon Europe Program (101148870 (ConTestCPS))
This publication has 31 references indexed in Scilit:
- Specifying Source Code and Signal-based Behaviour of Cyber-Physical System Components2022
- Specifying Properties over Inter-procedural, Source Code Level Behaviour of Programs2021
- Logical Signal Processing: A Fourier Analysis of Temporal Logic2020
- Explaining Violations of Properties in Control-Flow Temporal Logic2019
- Automatic Failure Explanation in CPS Models2019
- Introduction to Runtime Verification2018
- Trace Diagnostics Using Temporal Implicants2015
- The Periodic-Linear Model of Program Behavior Capture2005
- Monitoring Temporal Properties of Continuous Signals2004
- Specifying real-time properties with metric temporal logicReal-Time Systems, 1990