An Overview of the Empirical Evaluation of Explainable AI (XAI): A Comprehensive Guideline for User-Centered Evaluation in XAI
Top Cited Papers
Open Access
- 3 December 2024
- journal article
- review article
- Published by MDPI AG in Applied Sciences
- Vol. 14 (23) , 11288
Abstract
Recent advances in technology have propelled Artificial Intelligence (AI) into a crucial role in everyday life, enhancing human performance through sophisticated models and algorithms. However, the focus on predictive accuracy has often resulted in opaque black-box models that lack transparency in decision-making. To address this issue, significant efforts have been made to develop explainable AI (XAI) systems that make outcomes comprehensible to users. Various approaches, including new concepts, models, and user interfaces, aim to improve explainability, build user trust, enhance satisfaction, and increase task performance. Evaluation research has emerged to define and measure the quality of these explanations, differentiating between formal evaluation methods and empirical approaches that utilize techniques from psychology and human–computer interaction. Despite the importance of empirical studies, evaluations remain underutilized, with literature reviews indicating a lack of rigorous evaluations from the user perspective. This review aims to guide researchers and practitioners in conducting effective empirical user-centered evaluations by analyzing several studies; categorizing their objectives, scope, and evaluation metrics; and offering an orientation map for research design and metric measurement.Keywords
All Related Versions
This publication has 130 references indexed in Scilit:
- Keeping the organization in the loop: a socio-technical extension of human-centered artificial intelligenceAI & SOCIETY, 2022
- Explainable Artificial Intelligence (XAI): How the Visualization of AI Predictions Affects User Cognitive Load and Confidence2021
- News recommender system: a review of recent progress, challenges, and opportunitiesArtificial Intelligence Review, 2021
- Subjective Experiences2020
- Investigating the role of eye movements and physiological signals in search satisfaction prediction using geometric analysisJournal of the Association for Information Science and Technology, 2019
- The Pragmatic Turn in Explainable Artificial Intelligence (XAI)Minds and Machines, 2019
- Self-Report and Direct Measures of Health: Bias and Implications2016
- A Stakeholder Approach to Media Governance2016
- Explaining Recommendations: Design and Evaluation2015
- Designing and Evaluating Explanations for Recommender Systems2010