A Method for Building Trustworthy Hybrid Performance Models for Cyber-Physical Systems of Systems
Open Access
- 3 July 2024
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Access
- Vol. 12, 92733-92752
Abstract
The increasing dynamism and interconnectivity of Cyber-Physical Systems of Systems (CPSoS) emphasize the need for advanced performance modeling approaches. Performance models serve the purpose of exploring and evaluating design solutions, providing insights into system behavior during the early design phases, and managing performance risks during development. Despite the advancements in hybrid modeling within the field of performance modeling, the challenge of constructing models effectively and efficiently while ensuring their trustworthiness has not received much attention. This paper proposes a method, that is, step-by-step guidelines on using formalisms, techniques, and tools, to construct trustworthy hybrid models for analyzing and predicting stochastic timing performance of CPSoS. The method integrates design patterns for improved model design and development, alongside Bayesian calibration and statistical validation techniques to further enhance trustworthiness of the models. Although many individual techniques, formalisms and tools are available, our contribution lies in proposing a systematic method for achieving trustworthiness within the context of hybrid performance modeling and simulation. We concretize the method for cloud-based cyber-physical systems. Through two case studies, we show the efficacy of the proposed method for accurately predicting end-to-end latency of offloading imaging tasks to the cloud. The first case study showcases the application of design patterns in a practical scenario involving a cloud-based healthcare system—a collaboration with an industry partner in healthcare systems. The second case study has been implemented as a prototype to show the use of calibration and validation techniques with operational data in a laboratory context using an image-reconstruction application.Keywords
Funding Information
- TRANSACT project (https://transact-ecsel.eu) through the Electronic Components and Systems for European Leadership (ECSEL) Joint Undertaking (101007260)
- European Union’s Horizon 2020 research and innovation program and Netherlands, Finland, Germany, Poland, Austria, Spain, Belgium, Denmark, Norway
This publication has 21 references indexed in Scilit:
- Bayesian‐based calibration for water quality model parametersWater Environment Research, 2023
- A systematic review of agent-based models for autonomous vehicles in urban mobility and logistics: Possibilities for integrated simulation modelsComputers, Environment and Urban Systems, 2021
- Critical review of system dynamics modelling applications for water resources planning and managementCleaner Environmental Systems, 2021
- Hybrid simulation modelling in operational research: A state-of-the-art reviewEuropean Journal of Operational Research, 2019
- The Game of Drones: rapid agent-based machine-learning models for multi-UAV path planningComputational Mechanics, 2019
- Formulating and solving the integrated batching, routing, and picker scheduling problem in a real-life spare parts warehouseEuropean Journal of Operational Research, 2019
- Parallelization and High-Performance Computing Enables Automated Statistical Inference of Multi-scale ModelsCell Systems, 2017
- Aspects of Smart Manufacturing Via Agent-based ApproachProcedia Engineering, 2015
- A blueprint for system-level performance modeling of software-intensive embedded systemsInternational Journal on Software Tools for Technology Transfer, 2014
- Calibration of Abstract Performance Models for System-Level Design Space ExplorationJournal of Signal Processing Systems, 2007