Designing, Implementing, and Evaluating AI Explanations: A Scoping Review of Explainable AI Frameworks
Open Access
- 9 December 2025
- journal article
- review article
- Published by Association for Computing Machinery (ACM) in ACM Transactions on Computer-Human Interaction
- Vol. 32 (6) , 1-79
Abstract
As AI systems become increasingly integrated into our lives, the need to support appropriate human understanding of AI continues to grow. With new AI capabilities being deployed in different contexts, human-centered explainability is crucial to ensure people can interact with novel AI systems safely and effectively. To address evolving explainability needs, the field of Explainable AI (XAI) has produced numerous frameworks. But what do these frameworks entail and how can they be used in practice? What drives their development? As AI systems continue to grow in complexity, it is important to understand and reflect upon the value of these frameworks and their potential to address upcoming human-centered needs for XAI. Towards this, we performed a scoping review following the PRISMA-ScR procedure, gathering and analyzing a corpus of 73 papers to understand how XAI frameworks can support different stages of human-centered XAI design. We present a unified model and a set of guiding questions to help identify, compare and select relevant XAI frameworks across various design stages, making it easier for designers and researchers to apply human-centered approaches in real-world XAI contexts. We also analyze how frameworks are developed and evaluated, highlighting gaps and opportunities to improve both methodological as well as existing HCXAI practices.Keywords
Funding Information
- Science Foundation Ireland (13/RC/2094_P2)
This publication has 139 references indexed in Scilit:
- Explainable reinforcement learning for broad-XAI: a conceptual framework and surveyNeural Computing and Applications, 2023
- Assessing the communication gap between AI models and healthcare professionals: Explainability, utility and trust in AI-driven clinical decision-makingArtificial Intelligence, 2022
- A manifesto on explainability for artificial intelligence in medicineArtificial Intelligence in Medicine, 2022
- Knowledge graphs as tools for explainable machine learning: A surveyArtificial Intelligence, 2022
- XAITK: The explainable AI toolkitApplied AI Letters, 2021
- Levels of explainable artificial intelligence for human-aligned conversational explanationsArtificial Intelligence, 2021
- Abstraction, Validation, and Generalization for Explainable Artificial IntelligenceApplied AI Letters, 2021
- An Explainable Artificial Intelligence Framework for the Deterioration Risk Prediction of Hepatitis PatientsJournal of Medical Systems, 2021
- The Pragmatic Turn in Explainable Artificial Intelligence (XAI)Minds and Machines, 2019
- Asking ‘Why’ in AI: Explainability of intelligent systems – perspectives and challengesIntelligent Systems in Accounting, Finance and Management, 2018