XAIR: A Systematic Metareview of Explainable AI (XAI) Aligned to the Software Development Process
Top Cited Papers
Open Access
- 11 January 2023
- journal article
- review article
- Published by MDPI AG in Machine Learning and Knowledge Extraction
- Vol. 5 (1) , 78-108
Abstract
Currently, explainability represents a major barrier that Artificial Intelligence (AI) is facing in regard to its practical implementation in various application domains. To combat the lack of understanding of AI-based systems, Explainable AI (XAI) aims to make black-box AI models more transparent and comprehensible for humans. Fortunately, plenty of XAI methods have been introduced to tackle the explainability problem from different perspectives. However, due to the vast search space, it is challenging for ML practitioners and data scientists to start with the development of XAI software and to optimally select the most suitable XAI methods. To tackle this challenge, we introduce XAIR, a novel systematic metareview of the most promising XAI methods and tools. XAIR differentiates itself from existing reviews by aligning its results to the five steps of the software development process, including requirement analysis, design, implementation, evaluation, and deployment. Through this mapping, we aim to create a better understanding of the individual steps of developing XAI software and to foster the creation of real-world AI applications that incorporate explainability. Finally, we conclude with highlighting new directions for future research.Keywords
Funding Information
- Federal Ministry of Education and Research (02L19C155, 01IS21021A, 01IS17045)
This publication has 141 references indexed in Scilit:
- Does machine learning need fuzzy logic?Fuzzy Sets and Systems, 2015
- On Pixel-Wise Explanations for Non-Linear Classifier Decisions by Layer-Wise Relevance PropagationPLOS ONE, 2015
- Peeking Inside the Black Box: Visualizing Statistical Learning With Plots of Individual Conditional ExpectationJournal of Computational and Graphical Statistics, 2015
- Towards linguistic descriptions of phenomenaInternational Journal of Approximate Reasoning, 2013
- Dealing with trust and control: A meta-model for trustworthy information systems development2012
- Prototype selection for interpretable classificationThe Annals of Applied Statistics, 2011
- Adaptive deconvolutional networks for mid and high level feature learning2011
- Model-based performance prediction in software development: a surveyIEEE Transactions on Software Engineering, 2004
- Greedy function approximation: A gradient boosting machine.The Annals of Statistics, 2001
- Growing decision trees on support-less association rules2000