Visual Analysis of Hyperproperties for Understanding Model Checking Results
Authors:
- 29 September 2021
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Visualization and Computer Graphics
- Vol. 28 (1) , 357-367
Abstract
Model checkers provide algorithms for proving that a mathematical model of a system satisfies a given specification. In case of a violation, a counterexample that shows the erroneous behavior is returned. Understanding these counterexamples is challenging, especially for hyperproperty specifications, i.e., specifications that relate multiple executions of a system to each other. We aim to facilitate the visual analysis of such counterexamples through our H yper V is tool, which provides interactive visualizations of the given model, specification, and counterexample. Within an iterative and interdisciplinary design process, we developed visualization solutions that can effectively communicate the core aspects of the model checking result. Specifically, we introduce graphical representations of binary values for improving pattern recognition, color encoding for better indicating related aspects, visually enhanced textual descriptions, as well as extensive cross-view highlighting mechanisms. Further, through an underlying causal analysis of the counterexample, we are also able to identify values that contributed to the violation and use this knowledge for both improved encoding and highlighting. Finally, the analyst can modify both the specification of the hyperproperty and the system directly within H yper V is and initiate the model checking of the new version. In combination, these features notably support the analyst in understanding the error leading to the counterexample as well as iterating the provided system and specification. We ran multiple case studies with H yper V is and tested it with domain experts in qualitative feedback sessions. The participants' positive feedback confirms the considerable improvement over the manual, text-based status quo and the value of the tool for explaining hyperproperties.Keywords
All Related Versions
Funding Information
- DFG (389792660)
- DFG as part of the Germany's Excellence Strategy EXC 2050/1 (390696704)
- Cluster of Excellence “Centre for Tactile Internet” (CeTI) of TU Dresden
- European Research Council (683300)
- German Israeli Foundation (1-1513-407./2019)
This publication has 62 references indexed in Scilit:
- Semantics of OpenMath and MathML3Mathematics in Computer Science, 2012
- Secure information flow by self-compositionMathematical Structures in Computer Science, 2011
- An integrated framework for the analysis of dependable interactive systems (IFADIS): Its tool support and evaluationAutomated Software Engineering, 2006
- A Visualization Framework for the Modeling and Formal Analysis of High Assurance Systems2006
- Shortest Counterexamples for Symbolic Model Checking of LTL with Past2005
- Modular verification of software components in CIEEE Transactions on Software Engineering, 2004
- A Tool for Checking ANSI-C Programs2004
- Understanding Counterexamples with explain2004
- What Went Wrong: Explaining Counterexamples2003
- Symbolic mathematical computationCommunications of the ACM, 1985