The (Im)perfect Automation Schema: Who Is Trusted More, Automated or Human Decision Support?
- 26 August 2023
- journal article
- research article
- Published by SAGE Publications in Human Factors: The Journal of the Human Factors and Ergonomics Society
- Vol. 66 (8) , 1995-2007
Abstract
Objective: This study’s purpose was to better understand the dynamics of trust attitude and behavior in human-agent interaction. Background: Whereas past research provided evidence for a perfect automation schema, more recent research has provided contradictory evidence. Method: To disentangle these conflicting findings, we conducted an online experiment using a simulated medical X-ray task. We manipulated the framing of support agents (i.e., artificial intelligence (AI) versus expert versus novice) between-subjects and failure experience (i.e., perfect support, imperfect support, back-to-perfect support) within subjects. Trust attitude and behavior as well as perceived reliability served as dependent variables. Results: Trust attitude and perceived reliability were higher for the human expert than for the AI than for the human novice. Moreover, the results showed the typical pattern of trust formation, dissolution, and restoration for trust attitude and behavior as well as perceived reliability. Forgiveness after failure experience did not differ between agents. Conclusion: The results strongly imply the existence of an imperfect automation schema. This illustrates the need to consider agent expertise for human-agent interaction. Application: When replacing human experts with AI as support agents, the challenge of lower trust attitude towards the novel agent might arise.Keywords
This publication has 28 references indexed in Scilit:
- jsPsych: A JavaScript library for creating behavioral experiments in a Web browserBehavior Research Methods, 2014
- A comparative survey of artificial intelligence applications in finance: artificial neural networks, expert system and hybrid intelligent systemsNeural Computing and Applications, 2010
- Similarities and differences between human–human and human–automation trust: an integrative reviewTheoretical Issues in Ergonomics Science, 2007
- Trust in Automation: Designing for Appropriate RelianceHuman Factors: The Journal of the Human Factors and Ergonomics Society, 2004
- The role of trust in automation relianceInternational Journal of Human-Computer Studies, 2003
- Human observer detection experiments with mammograms and power‐law noiseMedical Physics, 2001
- Foundations for an Empirically Determined Scale of Trust in Automated SystemsInternational Journal of Cognitive Ergonomics, 2000
- User agreement with incorrect expert system adviceBehaviour & Information Technology, 1999
- Persuasiveness of expert systemsBehaviour & Information Technology, 1998
- Humans and Automation: Use, Misuse, Disuse, AbuseHuman Factors: The Journal of the Human Factors and Ergonomics Society, 1997