A Maturity Model for Practical Explainability in Artificial Intelligence‐Based Applications: Integrating Analysis and Evaluation (MM4XAI‐AE) Models
Open Access
- 1 January 2025
- journal article
- Published by Wiley in International Journal of Intelligent Systems
- Vol. 2025 (1)
Abstract
The increasing adoption of artificial intelligence (AI) in critical domains such as healthcare, law, and defense demands robust mechanisms to ensure transparency and explainability in decision‐making processes. While machine learning and deep learning algorithms have advanced significantly, their growing complexity presents persistent interpretability challenges. Existing maturity frameworks, such as Capability Maturity Model Integration, fall short in addressing the distinct requirements of explainability in AI systems, particularly where ethical compliance and public trust are paramount. To address this gap, we propose the Maturity Model for eXplainable Artificial Intelligence: Analysis and Evaluation (MM4XAI‐AE), a domain‐agnostic maturity model tailored to assess and guide the practical deployment of explainability in AI‐based applications. The model integrates two complementary components: an analysis model and an evaluation model, structured across four maturity levels—operational, justified, formalized, and managed. It evaluates explainability across three critical dimensions: technical foundations, structured design, and human‐centered explainability. MM4XAI‐AE is grounded in the PAG‐XAI framework, emphasizing the interrelated dimensions of practicality, auditability, and governance, thereby aligning with current reflections on responsible and trustworthy AI. The MM4XAI‐AE model is empirically validated through a structured evaluation of thirteen published AI applications from diverse sectors, analyzing their design and deployment practices. The results show a wide distribution across maturity levels, underscoring the model’s capacity to identify strengths, gaps, and actionable pathways for improving explainability. This work offers a structured and scalable framework to standardize explainability practices and supports researchers, developers, and policymakers in fostering more transparent, ethical, and trustworthy AI systems.Keywords
Funding Information
- Ministerio de Ciencia, Tecnología e Innovación
- Universidad del Cauca
This publication has 53 references indexed in Scilit:
- A Literature Review of Maturity Models for Cyber-Physical Production SystemsIFAC-PapersOnLine, 2024
- Assessing fidelity in XAI post-hoc techniques: A comparative study with ground truth explanations datasetsArtificial Intelligence, 2024
- Navigating software development in the ChatGPT and GitHub Copilot eraBusiness Horizons, 2024
- Artificial intelligence in timber forensics employing DNA barcode database3 Biotech, 2023
- Importance of 3D convolution and physics on a deep learning coastal fog modelEnvironmental Modelling & Software, 2022
- The explainability paradox: Challenges for xAI in digital pathologyFuture Generation Computer Systems, 2022
- Interpretable clinical time-series modeling with intelligent feature selection for early prediction of antimicrobial multidrug resistanceFuture Generation Computer Systems, 2022
- Explainability as a non-functional requirement: challenges and recommendationsRequirements Engineering, 2020
- Using Artificial Intelligence for Predicting Survival of Individual Grafts in Liver Transplantation: A Systematic ReviewLiver Transplantation, 2020
- Benchmarking in classification and regressionWIREs Data Mining and Knowledge Discovery, 2019