An Exploratory Study of V-Model in Building ML-Enabled Software: A Systems Engineering Perspective
Author:
Open Access
- 14 April 2024
- conference paper
- Published by Association for Computing Machinery (ACM)
- p. 30-40
Abstract
Machine learning (ML) components are being added to more and more critical and impactful software systems, but the software development process of real-world production systems from prototyped ML models remains challenging with additional complexity and interdisciplinary collaboration challenges. This poses difficulties in using traditional software lifecycle models such as waterfall, spiral, or agile models when building ML-enabled systems. In this research, we apply a Systems Engineering lens to investigate the use of V-Model in addressing the interdisciplinary collaboration challenges when building ML-enabled systems. By interviewing practitioners from software companies, we established a set of 8 propositions for using V-Model to manage interdisciplinary collaborations when building products with ML components. Based on the propositions, we found that despite requiring additional efforts, the characteristics of V-Model align effectively with several collaboration challenges encountered by practitioners when building ML-enabled systems. We recommend future research to investigate new process models that leverage the characteristics of V-Model such as the system decomposition, clear system boundary, and consistency of Validation & Verification (V&V) for building ML-enabled systems.Keywords
All Related Versions
This publication has 54 references indexed in Scilit:
- Comparison of multi-criteria decision-making methods for online controlled experiments in a launch decision-making frameworkInformation and Software Technology, 2022
- Towards a Data Engineering Process in Data-Driven Systems Engineering2022
- Beyond effective use: Integrating wise reasoning in machine learning developmentInternational Journal of Information Management, 2022
- A software engineering perspective on engineering machine learning systems: State of the art and challengesJournal of Systems and Software, 2021
- AI lifecycle models need to be revisedEmpirical Software Engineering, 2021
- The Systems Engineering DevOps Lemniscate and Model-Based System OperationsIEEE Systems Journal, 2020
- A survey of safety and trustworthiness of deep neural networks: Verification, testing, adversarial attack and defence, and interpretabilityComputer Science Review, 2020
- On testing machine learning programsJournal of Systems and Software, 2020
- Software Engineering for Machine Learning: A Case Study2019
- Using multi criteria decision making in analysis of alternatives for selection of enabling technologySystems Engineering, 2012