The Analysis and Development of an XAI Process on Feature Contribution Explanation
Authors:
- 17 December 2022
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 5039-5048
Abstract
Explainable Artificial Intelligence (XAI) research focuses on effective explanation techniques to understand and build AI models with trust, reliability, safety, and fairness. Feature importance explanation summarizes feature contributions for end-users to make model decisions. However, XAI methods may produce varied summaries that lead to further analysis to evaluate the consistency across multiple XAI methods on the same model and data set. This paper defines metrics to measure the consistency of feature contribution explanation summaries under feature importance order and saliency map. Driven by these consistency metrics, we develop an XAI process oriented on the XAI criterion of feature importance, which performs a systematical selection of XAI techniques and evaluation of explanation consistency. We demonstrate the process development involving twelve XAI methods on three topics, including a search ranking system, code vulnerability detection and image classification. Our contribution is a practical and systematic process with defined consistency metrics to produce rigorous feature contribution explanations.Keywords
This publication has 20 references indexed in Scilit:
- Grad-CAM++: Generalized Gradient-Based Visual Explanations for Deep Convolutional Networks2018
- Semantic ScholarJournal of the Medical Library Association, 2018
- Grad-CAM: Visual Explanations from Deep Networks via Gradient-Based Localization2017
- Explaining Recurrent Neural Network Predictions in Sentiment Analysis2017
- Interpretable Decision Sets2016
- Deep Residual Learning for Image Recognition2016
- Learning Deep Features for Discriminative Localization2016
- Interpretable classifiers using rules and Bayesian analysis: Building a better stroke prediction modelThe Annals of Applied Statistics, 2015
- Too much, too little, or just right? Ways explanations impact end users' mental models2013
- Explaining prediction models and individual predictions with feature contributionsKnowledge and Information Systems, 2013