On Benchmarking for Concurrent Runtime Verification
Open Access
- 20 March 2021
- book chapter
- Published by Springer Nature
- Vol. 12649, 3-23
Abstract
We present a synthetic benchmarking framework that targets the systematic evaluation of RV tools for message-based concurrent systems. Our tool can emulate various load profiles via configuration. It provides a multi-faceted view of measurements that is conducive to a comprehensive assessment of the overhead induced by runtime monitoring. The tool is able to generate significant loads to reveal edge case behaviour that may only emerge when the monitoring system is pushed to its limit. We evaluate our framework in two ways. First, we conduct sanity checks to assess the precision of the measurement mechanisms used, the repeatability of the results obtained, and the veracity of the behaviour emulated by our synthetic benchmark. We then showcase the utility of the features offered by our tool in a two-part RV case study.Keywords
This publication has 41 references indexed in Scilit:
- Determinizing monitors for HML with recursionJournal of Logical and Algebraic Methods in Programming, 2020
- Run, actor, run: towards cross-actor language benchmarking2019
- The Complexity of Monitoring Hyperproperties2018
- Introduction to Runtime Verification2018
- Trace Partitioning and Local Monitoring for Asynchronous Components2017
- A Monitoring Tool for a Branching-Time Logic2016
- Runtime verification with minimal intrusion through parallelismFormal Methods in System Design, 2015
- Cloud Computing2011
- The DaCapo benchmarksACM SIGPLAN Notices, 2006
- A foundation for actor computationJournal of Functional Programming, 1997