Finding the right XAI method -- A Guide for the Evaluation and Ranking of Explainable AI Methods in Climate Science
Authors:
- Marina M. -C. HöhneMHMarina M. -C. Höhne
Preprint
Abstract
Explainable artificial intelligence (XAI) methods shed light on the predictions of deep neural networks (DNNs). Several different approaches exist and have partly already been successfully applied in climate science. However, the often missing ground truth explanations complicate their evaluation and validation, subsequently compounding the choice of the XAI method. Therefore, in this work, we introduce XAI evaluation in the context of climate research and assess different desired explanation properties, namely, robustness, faithfulness, randomization, complexity, and localization. To this end we build upon previous work and train a multi-layer perceptron (MLP) and a convolutional neural network (CNN) to predict the decade based on annual-mean temperature maps. Next, multiple local XAI methods are applied and their performance is quantified for each evaluation property and compared against a baseline test. Independent of the network type, we find that the XAI methods Integrated Gradients, Layer-wise relevance propagation, and InputGradients exhibit considerable robustness, faithfulness, and complexity while sacrificing randomization. The opposite is true for Gradient, SmoothGrad, NoiseGrad, and FusionGrad. Notably, explanations using input perturbations, such as SmoothGrad and Integrated Gradients, do not improve robustness and faithfulness, contrary to previous claims. Overall, our experiments offer a comprehensive overview of different properties of explanation methods in the climate science context and supports users in the selection of a suitable XAI method.Keywords
All Related Versions
This publication has 46 references indexed in Scilit:
- Evaluating feature attribution methods in the image domainMachine Learning, 2024
- This looks More Like that: Enhancing Self-Explaining Models by Prototypical Relevance PropagationPattern Recognition, 2022
- CLEVR-XAI: A benchmark dataset for the ground truth evaluation of neural network explanationsInformation Fusion, 2022
- Trustworthy artificial intelligenceElectronic Markets, 2020
- Explainable Artificial Intelligence (XAI): Concepts, taxonomies, opportunities and challenges toward responsible AIInformation Fusion, 2020
- Towards a more reliable historical reanalysis: Improvements for version 3 of the Twentieth Century Reanalysis systemQuarterly Journal of the Royal Meteorological Society, 2019
- Methods for interpreting and understanding deep neural networksDigital Signal Processing, 2018
- Top-Down Neural Attention by Excitation BackpropInternational Journal of Computer Vision, 2017
- Explaining nonlinear classification decisions with deep Taylor decompositionPattern Recognition, 2017
- A machine learning nowcasting method based on real‐time reanalysis dataJournal of Geophysical Research: Atmospheres, 2017