Metrics for software process simulation modeling
Authors:
- 11 July 2024
- journal article
- research article
- Published by Wiley in Journal of Software: Evolution and Process
- Vol. 36 (11)
Abstract
Software process simulation (SPS) has become an effective tool for software process management and improvement. However, its adoption in industry is less than what the research community expected due to the burden of measurement cost and the high demand for domain knowledge. The difficulty of extracting appropriate metrics with real data from process enactment is one of the great challenges. We aim to provide evidence‐based support of the process metrics for software process (simulation) modeling. A systematic literature review was performed by extending our previous review series to draw a comprehensive understanding of the metrics for process modeling following our proposed ontology of metrics in SPS. We identify 131 process modeling studies that collectively involve 1975 raw metrics and classified them into 21 categories using the coding technique. We found product and process external metrics are not used frequently in SPS modeling while resource external metrics are widely used. We analyze the causal relationships between metrics. We find that the models exhibit significant diversity, as no pairwise relationship between metrics accounts for more than 10% SPS models. We identify 17 data issues may encounter in measurement and 10 coping strategies. The results of this study provide process modelers with an evidence‐based reference of the identification and the use of metrics in SPS modeling and further contribute to the development of the body of knowledge on software metrics in the context of process modeling. Furthermore, this study is not limited to process simulation but can be extended to software process modeling, in general. Taking simulation metrics as standards and references can further motivate and guide software developers to improve the collection, governance, and application of process data in practice.Keywords
All Related Versions
Funding Information
- National Natural Science Foundation of China (62072227, 62202219, 62302210, 72372070)
- Norges Forskningsråd
- Jiangsu Provincial Key Research and Development Program (BE2021002‐2)
This publication has 154 references indexed in Scilit:
- Software process simulation—at a crossroads?Journal of Software: Evolution and Process, 2014
- Simulation of software maintenance process, with and without a work‐in‐process limitJournal of Software: Evolution and Process, 2013
- Hybrid modeling and simulation for trustworthy software process management: a stakeholder‐oriented approachJournal of Software: Evolution and Process, 2012
- The use of search‐based optimization techniques to schedule and staff software projects: an approach and an empirical studySoftware: Practice and Experience, 2011
- Modeling and scenario simulation for decision support in management of requirements activities in software projectsJournal of Software Maintenance and Evolution: Research and Practice, 2011
- Behavioural modelling of long‐lived evolution processes—some issues and an exampleJournal of Software Maintenance and Evolution: Research and Practice, 2002
- Simulating global software evolution processes by combining simple models: an initial studySoftware Process: Improvement and Practice, 2002
- A model of the software development process using both continuous and discrete modelsSoftware Process: Improvement and Practice, 2000
- Case studies in software process modeling with system dynamicsSoftware Process: Improvement and Practice, 2000
- Coordinating models and metrics to manage software projectsSoftware Process: Improvement and Practice, 2000