Deep learning's fitness for purpose: A transformation problem frame's perspective
Open Access
- 7 June 2023
- journal article
- research article
- Published by Institution of Engineering and Technology (IET) in CAAI Transactions on Intelligence Technology
- Vol. 8 (2) , 343-354
Abstract
Combined sewer overflows represent significant risks to human health as untreated water is discharged to the environment. Municipalities, such as the Metropolitan Sewer District of Greater Cincinnati (MSDGC), recently began collecting large amounts of water‐related data and considering the adoption of deep learning (DL) solutions like recurrent neural network (RNN) for predicting overflow events. Clearly, assessing the DL's fitness for the purpose requires a systematic understanding of the problem context. In this study, we propose a requirements engineering framework that uses the problem frames to identify and structure the stakeholder concerns, analyses the physical situations in which the high‐quality data assumptions may not hold, and derives the software testing criteria in the form of metamorphic relations that incorporate both input transformations and output comparisons. Applying our framework to MSDGC's overflow prediction problem enables a principled way to evaluate different RNN solutions in meeting the requirements.Keywords
This publication has 29 references indexed in Scilit:
- Adaptive Testing Based on Moment EstimationIEEE Transactions on Systems, Man, and Cybernetics: Systems, 2017
- Advancing viewpoint merging in requirements engineering: a theoretical replication and explanatory studyRequirements Engineering, 2017
- Validating a Deep Learning Framework by Metamorphic Testing2017
- Advancing Repeated Research in Requirements Engineering: A Theoretical Replication of Viewpoint Merging2016
- A Survey on Metamorphic TestingIEEE Transactions on Software Engineering, 2016
- TimePF: A Tool for Modeling and Verifying Timing Requirements Based on Problem Frames2015
- Urban Stormwater Runoff Prediction Using Recurrent Neural Networks2011
- The essential synthesis of problem frames and assurance casesExpert Systems, 2008
- The Analysis of Time Series2003
- Non-Functional Requirements in Software Engineering2000