(Some) Benefits in Operator Decisions to Use AI After Experiencing Optimal Outcomes
- 18 October 2025
- journal article
- Published by SAGE Publications in Human Factors: The Journal of the Human Factors and Ergonomics Society
- Vol. 68 (3) , 368-380
Abstract
Objective: The current study aimed to explore the impacts of experiencing superior behaviors—accumulating large amounts of evidence and high automation use rates—on subsequent evidence accumulation rates and adaptable (discretionary) automation use decisions in a dynamic decision-making task. Background: Operators prefer to choose when to engage automated support systems but seldom use them appropriately. They also do not typically collect enough evidence to optimize their decision making. This creates suboptimal performance that could benefit from training better behaviors. Method: Participants collected evidence about movement patterns of ships while assisted by a machine learning aid. They were initially required to collect high levels of evidence and use the aid as a form of hands-on training. Then, they chose how much evidence to collect and when to engage the aid. Results: When given the choice, operators collected less evidence and used the automation less often than had been required during training, but improved their performance compared to unaided trials. Conclusion: Providing operators with early experience of superior behavioral strategies can improve their subsequent decisions. This is a promising direction for achieving human–automation team synergy. Applications: Short exposures to optimal behaviors may be a feasible training approach to improve human–automation interactions in contexts where operators want decisional freedom in their interactions.Keywords
Funding Information
- Office of Naval Research (N00014-20-1-2518)
This publication has 47 references indexed in Scilit:
- Adaptable automation for a more human-centered work design? Effects on human perception and behaviorInternational Journal of Human-Computer Studies, 2024
- Meta-analysis Qualifying and Quantifying the Benefits of Automation Transparency to Enhance Models of Human Performance2023
- Evaluating Automated Vehicle Human–Machine Interfaces and the Relationship Between Preference and Performance Measures2022
- Decisions for information or information for decisions? Optimizing information gathering in decision-intensive processesDecision Support Systems, 2021
- System reliability, performance and trust in adaptable automationApplied Ergonomics, 2016
- Cognitive economy and satisficing in information seeking: A longitudinal study of undergraduate information behaviorJournal of the American Society for Information Science and Technology, 2009
- Misuse of automated decision aids: Complacency, automation bias and the impact of training experienceInternational Journal of Human-Computer Studies, 2008
- Decision support for real-time, dynamic decision-making tasksOrganizational Behavior and Human Decision Processes, 2005
- A Decision-Theoretic Generalization of On-Line Learning and an Application to BoostingJournal of Computer and System Sciences, 1997
- Experts, amateurs, and real estate: An anchoring-and-adjustment perspective on property pricing decisionsOrganizational Behavior and Human Decision Processes, 1987