Helpful, Misleading or Confusing: How Humans Perceive Fundamental Building Blocks of Artificial Intelligence Explanations
Preprint
Abstract
Explainable artificial intelligence techniques are developed at breakneck speed, but suitable evaluation approaches lag behind. With explainers becoming increasingly complex and a lack of consensus on how to assess their utility, it is challenging to judge the benefit and effectiveness of different explanations. To address this gap, we take a step back from sophisticated predictive algorithms and instead look into explainability of simple decision-making models. In this setting, we aim to assess how people perceive comprehensibility of their different representations such as mathematical formulation, graphical representation and textual summarisation (of varying complexity and scope). This allows us to capture how diverse stakeholders -- engineers, researchers, consumers, regulators and the like -- judge intelligibility of fundamental concepts that more elaborate artificial intelligence explanations are built from. This position paper charts our approach to establishing appropriate evaluation methodology as well as a conceptual and practical framework to facilitate setting up and executing relevant user studies.Keywords
All Related Versions
This publication has 10 references indexed in Scilit:
- LIME: Consistent and Faithful Surrogate Explanations of Multiple ClassesElectronics, 2025
- Trust in Artificial Intelligence: A global study2023
- What and How of Machine Learning Transparency: Building Bespoke Explainability Tools with Interoperable Algorithmic ComponentsJournal of Open Source Education, 2022
- A Survey on Bias and Fairness in Machine LearningACM Computing Surveys, 2021
- Principles and Practice of Explainable Machine LearningFrontiers in Big Data, 2021
- Explainable Artificial Intelligence: Objectives, Stakeholders, and Future Research OpportunitiesInformation Systems Management, 2020
- "Hello AI": Uncovering the Onboarding Needs of Medical Practitioners for Human-AI Collaborative Decision-MakingProceedings of the ACM on Human-Computer Interaction, 2019
- Stop explaining black box machine learning models for high stakes decisions and use interpretable models insteadNature Machine Intelligence, 2019
- Glass-Box: Explaining AI Decisions With Counterfactual Statements Through Conversation With a Voice-enabled Virtual Assistant2018
- Women, Language and IdentityJournal of Sociolinguistics, 1997