CoDefeater: Using LLMs To Find Defeaters in Assurance Cases
Open Access
- 27 October 2024
- conference paper
- Published by Association for Computing Machinery (ACM)
- p. 2262-2267
Abstract
Constructing assurance cases is a widely used and sometimes required process toward demonstrating that safety-critical systems will operate safely in their planned environment. To mitigate the risk of errors and missing edge cases, the concept of defeaters - challenges to claims in an assurance case - has been introduced. Defeaters can detect weaknesses in the arguments, prompting further investigation and timely mitigations. However, capturing defeaters relies on expert judgment, experience, and creativity and must be done iteratively due to evolving requirements and regulations. In this paper, we propose CoDefeater, an automated process to leverage large language models (LLMs) for finding defeaters. Initial results on two systems show that LLMs can efficiently find known and unforeseen feasible defeaters to support safety analysts in enhancing the completeness and confidence of assurance cases.Keywords
All Related Versions
Funding Information
- National Aeronautics and Space Administration (80NSSC23M0058)
This publication has 25 references indexed in Scilit:
- Confidence in Assurance 2.0 Cases2024
- Can Large Language Models Assist in Hazard Analysis?2023
- Large Language Models for Software Engineering: Survey and Open Problems2023
- Assurance Case Development as Data: A Manifesto2023
- Medical cyber-physical systems: A surveyJournal of Medical Systems, 2018
- Reasoning About Confidence and Uncertainty in Assurance Cases: A Survey2017
- An extended systematic literature review on provision of evidence for safety certificationInformation and Software Technology, 2014
- ISO 26262 safety cases: compliance and assurance2011
- A New Approach to creating Clear Safety Arguments2010
- Critical system properties: survey and taxonomyReliability Engineering & System Safety, 1994