How people reason with counterfactual and causal explanations for Artificial Intelligence decisions in familiar and unfamiliar domains
Open Access
- 24 March 2023
- journal article
- research article
- Published by Springer Nature in Memory & Cognition
- Vol. 51 (7) , 1481-1496
Abstract
Few empirical studies have examined how people understand counterfactual explanations for other people’s decisions, for example, “if you had asked for a lower amount, your loan application would have been approved”.Yet many current Artificial Intelligence (AI) decision support systems rely on counterfactual explanations to improve human understanding and trust. We compared counterfactual explanations to causal ones, i.e.,“because you asked for a high amount, your loan application was not approved”, for an AI’s decisions in a familiar domain (alcohol and driving) and an unfamiliar one (chemical safety) in four experiments (n = 731). Participants were shown inputs to an AI system, its decisions, and an explanation for each decision; they attempted to predict the AI’s decisions, or to make their own decisions. Participants judged counterfactual explanations more helpful than causal ones, but counterfactuals did not improve the accuracy of their predictions of the AI’s decisions more than causals (Experiment 1). However, counterfactuals improved the accuracy of participants’ own decisions more than causals (Experiment 2). When the AI’s decisions were correct (Experiments 1 and 2), participants considered explanations more helpful and made more accurate judgements in the familiar domain than in the unfamiliar one; but when the AI’s decisions were incorrect, they considered explanations less helpful and made fewer accurate judgements in the familiar domain than the unfamiliar one, whether they predicted the AI’s decisions (Experiment 3a) or made their own decisions (Experiment 3b). The results corroborate the proposal that counterfactuals provide richer information than causals, because their mental representation includes more possibilities.Keywords
Funding Information
- University of Dublin, Trinity College
This publication has 67 references indexed in Scilit:
- The Strategic Use of Counterfactual Communication in PoliticsJournal of Language and Social Psychology, 2013
- Causal conditionals and counterfactualsActa Psychologica, 2012
- Counterfactual thinking facilitates behavioral intentionsJournal of Experimental Social Psychology, 2009
- Spontaneous counterfactual thoughts and causal explanationsThinking & Reasoning, 2006
- Omission bias, individual differences, and normalityOrganizational Behavior and Human Decision Processes, 2004
- Semifactual “even if” thinkingThinking & Reasoning, 2002
- When Possibility Informs RealityCurrent Directions in Psychological Science, 1999
- Rape and Accident Counterfactuals: Who Might Have Done Otherwise and Would It Have Changed the Outcome?1Journal of Applied Social Psychology, 1996
- Outcome Knowledge, Regret, and Omission BiasOrganizational Behavior and Human Decision Processes, 1995
- REASONING AND A SENSE OF REALITYBritish Journal of Psychology, 1972