Robyn R. Lutz
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Previous Organizations / Institutes
The organizations / institutes from the scholar's other articles in the past ten years
Research Subjects
Robyn R. Lutz has a total of 35 co-authors. Here are the top co-authors by number of shared publications:
- Chin Khor
Iowa State University, Ames, USA
4 shared publications - Katerina Goseva-Popstojanova
Lane Department of Computer Science and Electrical Engineering, West Virginia University, Morgantown, USA
3 shared publications - Myra B. Cohen
Iowa State University, Ames, USA
3 shared publications - Jane Cleland-Huang
University of Notre Dame, Notre Dame, Indiana, USA
2 shared publications - Michael C. Hunter
Iowa State University, Ames, Iowa, USA
2 shared publications - Sandeep Krishnan
Department of Computer Science, Iowa State University, Ames, USA
2 shared publications
Latest Publications
- Open Access
- 3 October 2026
- Published by Association for Computing Machinery (ACM)
- p. 126-131
VarCHEKER: A Variability-Based Static Analyzer for Python Applications
- 3 October 2026
- Published by Association for Computing Machinery (ACM)
- p. 126-131
Open AccessVarCHEKER: A Variability-Based Static Analyzer for Python Applications
- 7 January 2026
- Published by Elsevier in Information and Software Technology
- Vol. 192
Requirements-driven analysis of variability in configurable software
- 7 January 2026
- Published by Elsevier in Information and Software Technology
- Vol. 192
Requirements-driven analysis of variability in configurable software
- Open Access
A Taxonomy of Real-World Defeaters in Safety Assurance Cases
The rise of cyber-physical systems in safety-critical domains calls for robust risk-evaluation frameworks. Assurance cases, often required by regulatory bodies, are a structured approach to demonstrate that a system meets its safety requirements. However, assurance cases are fraught with challenges, such as incomplete evidence and gaps in reasoning, called defeaters, that can call into question the credibility and robustness of assurance cases. Identifying these defeaters increases confidence in the assurance case and can prevent catastrophic failures. The search for defeaters in an assurance case, however, is not structured, and there is a need to standardize defeater analysis. The software engineering community thus could benefit from having a reusable classification of real-world defeaters in software assurance cases. In this paper, we conducted a systematic study of literature from the past 20 years. Using open coding, we derived a taxonomy with seven broad categories, laying the groundwork for standardizing the analysis and management of defeaters in safety-critical systems. We provide our artifacts as open source for the community to use and build upon, thus establishing a common framework for understanding defeaters.
Open AccessA Taxonomy of Real-World Defeaters in Safety Assurance Cases
The rise of cyber-physical systems in safety-critical domains calls for robust risk-evaluation frameworks. Assurance cases, often required by regulatory bodies, are a structured approach to demonstrate that a system meets its safety requirements. However, assurance cases are fraught with challenges, such as incomplete evidence and gaps in reasoning, called defeaters, that can call into question the credibility and robustness of assurance cases. Identifying these defeaters increases confidence in the assurance case and can prevent catastrophic failures. The search for defeaters in an assurance case, however, is not structured, and there is a need to standardize defeater analysis. The software engineering community thus could benefit from having a reusable classification of real-world defeaters in software assurance cases. In this paper, we conducted a systematic study of literature from the past 20 years. Using open coding, we derived a taxonomy with seven broad categories, laying the groundwork for standardizing the analysis and management of defeaters in safety-critical systems. We provide our artifacts as open source for the community to use and build upon, thus establishing a common framework for understanding defeaters.
- Open Access
- 27 October 2024
- Published by Association for Computing Machinery (ACM)
- p. 2262-2267
CoDefeater: Using LLMs To Find Defeaters in Assurance Cases
Constructing assurance cases is a widely used and sometimes required process toward demonstrating that safety-critical systems will operate safely in their planned environment. To mitigate the risk of errors and missing edge cases, the concept of defeaters - challenges to claims in an assurance case - has been introduced. Defeaters can detect weaknesses in the arguments, prompting further investigation and timely mitigations. However, capturing defeaters relies on expert judgment, experience, and creativity and must be done iteratively due to evolving requirements and regulations. In this paper, we propose CoDefeater, an automated process to leverage large language models (LLMs) for finding defeaters. Initial results on two systems show that LLMs can efficiently find known and unforeseen feasible defeaters to support safety analysts in enhancing the completeness and confidence of assurance cases.
- 27 October 2024
- Published by Association for Computing Machinery (ACM)
- p. 2262-2267
Open AccessCoDefeater: Using LLMs To Find Defeaters in Assurance Cases
Constructing assurance cases is a widely used and sometimes required process toward demonstrating that safety-critical systems will operate safely in their planned environment. To mitigate the risk of errors and missing edge cases, the concept of defeaters - challenges to claims in an assurance case - has been introduced. Defeaters can detect weaknesses in the arguments, prompting further investigation and timely mitigations. However, capturing defeaters relies on expert judgment, experience, and creativity and must be done iteratively due to evolving requirements and regulations. In this paper, we propose CoDefeater, an automated process to leverage large language models (LLMs) for finding defeaters. Initial results on two systems show that LLMs can efficiently find known and unforeseen feasible defeaters to support safety analysts in enhancing the completeness and confidence of assurance cases.
- 17 June 2024
- Published by Springer Nature in Requirements Engineering
- Vol. 29 (3) , 303-328
Enhancing the requirements engineering of configurable systems by the ongoing use of variability models
- 17 June 2024
- Published by Springer Nature in Requirements Engineering
- Vol. 29 (3) , 303-328
Enhancing the requirements engineering of configurable systems by the ongoing use of variability models
- 8 June 2024
- Published by Springer Nature in Empirical Software Engineering
- Vol. 29 (4) , 1-37
The untold impact of learning approaches on software fault-proneness predictions: an analysis of temporal aspects
- 8 June 2024
- Published by Springer Nature in Empirical Software Engineering
- Vol. 29 (4) , 1-37
The untold impact of learning approaches on software fault-proneness predictions: an analysis of temporal aspects
- Open Access
- 14 April 2024
- Published by Association for Computing Machinery (ACM)
- p. 177-188
Towards Engineering Fair and Equitable Software Systems for Managing Low-Altitude Airspace Authorizations
Small Unmanned Aircraft Systems (sUAS) have gained widespread adoption across a diverse range of applications. This has introduced operational complexities within shared airspaces and an increase in reported incidents, raising safety concerns. In response, the U.S. Federal Aviation Administration (FAA) is developing a UAS Traffic Management (UTM) system to control access to airspace based on an sUAS's predicted ability to safely complete its mission. However, a fully automated system capable of swiftly approving or denying flight requests can be prone to bias and must consider safety, transparency, and fairness to diverse stakeholders. In this paper, we present an initial study that explores stakeholders' perspectives on factors that should be considered in an automated system. Results indicate flight characteristics and environmental conditions were perceived as most important but pilot and drone capabilities should also be considered. Further, several respondents indicated an aversion to any AI-supported automation, highlighting the need for full transparency in automated decision-making. Results provide a societal perspective on the challenges of automating UTM flight authorization decisions and help frame the ongoing design of a solution acceptable to the broader sUAS community.
- 14 April 2024
- Published by Association for Computing Machinery (ACM)
- p. 177-188
Open AccessTowards Engineering Fair and Equitable Software Systems for Managing Low-Altitude Airspace Authorizations
Small Unmanned Aircraft Systems (sUAS) have gained widespread adoption across a diverse range of applications. This has introduced operational complexities within shared airspaces and an increase in reported incidents, raising safety concerns. In response, the U.S. Federal Aviation Administration (FAA) is developing a UAS Traffic Management (UTM) system to control access to airspace based on an sUAS's predicted ability to safely complete its mission. However, a fully automated system capable of swiftly approving or denying flight requests can be prone to bias and must consider safety, transparency, and fairness to diverse stakeholders. In this paper, we present an initial study that explores stakeholders' perspectives on factors that should be considered in an automated system. Results indicate flight characteristics and environmental conditions were perceived as most important but pilot and drone capabilities should also be considered. Further, several respondents indicated an aversion to any AI-supported automation, highlighting the need for full transparency in automated decision-making. Results provide a societal perspective on the challenges of automating UTM flight authorization decisions and help frame the ongoing design of a solution acceptable to the broader sUAS community.
- Open Access
Requirements Analysis of Variability Constraints in a Configurable Flight Software System
Variability constraints are an integral part of the requirements for a configurable system. The constraints specified in the requirements on the legal combinations of options define the space of potential valid configurations for the system-to-be. This paper reports on our experience with the variability-related requirements constraints of a flight software framework used by multiple space missions. A challenge that we saw for practitioners using the current framework, now open-sourced, is that the specifications of its variability-related requirements and constraints are dispersed across several documents, rather than being centralized in the software requirements specification. Such dispersion can contribute to misunderstandings of the side-effects of design choices, increased effort for developers, and bugs during operations. Based on our experience, we propose a new software variability model, similar to a product-line feature model, in the flight software framework. We describe the structured technique by which our model is developed, demonstrate its use, and evaluate it on a key service module of the flight software. Results show that our lightweight modeling technique helped find missing and inconsistent variability-related requirements and constraints. More generally, we suggest that a variability modeling technique such as this can be an efficient way for developers to centralize the specification and improve the analysis of dispersed variability-related requirements and constraints in other configurable systems.
Open AccessRequirements Analysis of Variability Constraints in a Configurable Flight Software System
Variability constraints are an integral part of the requirements for a configurable system. The constraints specified in the requirements on the legal combinations of options define the space of potential valid configurations for the system-to-be. This paper reports on our experience with the variability-related requirements constraints of a flight software framework used by multiple space missions. A challenge that we saw for practitioners using the current framework, now open-sourced, is that the specifications of its variability-related requirements and constraints are dispersed across several documents, rather than being centralized in the software requirements specification. Such dispersion can contribute to misunderstandings of the side-effects of design choices, increased effort for developers, and bugs during operations. Based on our experience, we propose a new software variability model, similar to a product-line feature model, in the flight software framework. We describe the structured technique by which our model is developed, demonstrate its use, and evaluate it on a key service module of the flight software. Results show that our lightweight modeling technique helped find missing and inconsistent variability-related requirements and constraints. More generally, we suggest that a variability modeling technique such as this can be an efficient way for developers to centralize the specification and improve the analysis of dispersed variability-related requirements and constraints in other configurable systems.
- Open Access
- 5 July 2023
- Published by Springer Nature
- p. 271-278
Reasoning As If
It is occasionally useful toreason as ifsomething were true, even when we know that it is almost certainly not true. We discuss two instances, one in distributed computing and one in tile self-assembly, and suggest directions for further investigation of this method.
- 5 July 2023
- Published by Springer Nature
- p. 271-278
Open AccessReasoning As If
It is occasionally useful toreason as ifsomething were true, even when we know that it is almost certainly not true. We discuss two instances, one in distributed computing and one in tile self-assembly, and suggest directions for further investigation of this method.
- 23 September 2019
- Published by Springer Nature
- p. 293-307
Leveraging Feature Similarity for Earlier Detection of Unwanted Feature Interactions in Evolving Software Product Lines
- 23 September 2019
- Published by Springer Nature
- p. 293-307
Leveraging Feature Similarity for Earlier Detection of Unwanted Feature Interactions in Evolving Software Product Lines