Automated Extraction of Security Profile Information from XAI Outcomes
Authors:
- 25 September 2023
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 110-115
Abstract
Security applications use machine learning (ML) models and artificial intelligence (AI) to autonomously protect systems. However, security decisions are more impactful if they are coupled with their rationale. The explanation behind an ML model's result provides the rationale necessary for a security decision. Explainable AI (XAI) techniques provide insights into the state of a model's attributes and their contribution to the model's results to gain the end user's confidence. It requires human intervention to investigate and interpret the explanation. The interpretation must align system's security profile(s). A security profile is an abstraction of the system's security requirements and related functionalities to comply with them. Relying on human intervention for interpretation is infeasible for an autonomous system (AS) since it must self-adapt its functionalities in response to uncertainty at runtime. Thus, an AS requires an automated approach to extract security profile information from ML model XAI outcomes. The challenge is unifying the XAI outcomes with the security profile to represent the interpretation in a structured form. This paper presents a component to facilitate AS information extraction from ML model XAI outcomes related to predictions and generating an interpretation considering the security profile.Keywords
This publication has 19 references indexed in Scilit:
- Assessing Adaptations based on Change Impacts2020
- Autonomous Vehicle: Security by DesignIEEE Transactions on Intelligent Transportation Systems, 2020
- Security Modeling of Autonomous SystemsACM Computing Surveys, 2019
- Stop explaining black box machine learning models for high stakes decisions and use interpretable models insteadNature Machine Intelligence, 2019
- Software Engineering of Self-adaptive Systems2019
- Activation functions and their characteristics in deep neural networks2018
- The Notion of Self-aware Computing2017
- "Why Should I Trust You?"2016
- Mutual Information between Discrete and Continuous Data SetsPLOS ONE, 2014
- The vision of autonomic computingComputer, 2003