I Need Your Help... or Do I?
Open Access
- 13 March 2023
- conference paper
- Published by Association for Computing Machinery (ACM)
- p. 122-131
Abstract
Interactive intelligent systems are increasingly being deployed in safety critical contexts like Space Exploration. For humans to safely and successfully complete collaborative tasks with robots in these contexts, they must maintain Situational Awareness of their task context without being cognitively overloaded -- regardless of whether they are co-located with robots or interacting with them from a distance of thousands or millions of miles. In this paper, we present a novel autonomy design strategy we term Performative Autonomy, in which robots behave as if they have a lower level of autonomy than they are truly capable of (i.e., asking for advice they do not believe they truly need), for the sole purpose of maintaining interactants' Situational Awareness. In our first experiment (n=264), we begin by demonstrating that Performative Autonomy can increase Situational Awareness (SA) without overly increasing workload, and that this is true across tasks with different baseline levels of Mental Workload. In our second experiment (n=318), we consider cases where robots do not believe they need advice, but in fact have faulty perception or decision making capabilities. In this experiment, we only observed benefits to Performative Autonomy for specific types of questions, and only when there was significant cognitive load imposed by a secondary task; yet we observed uniform benefit on task performance for asking these types of questions regardless of task-imposed Mental workload. Our results from these two studies (total n=582) thus provide strong support for using this autonomy design strategy in future safety-critical missions as humanity explores the Moon, Mars, and beyond.Keywords
Funding Information
- NASA (80NSSC20K0070)
This publication has 33 references indexed in Scilit:
- Why did my car just do that? Explaining semi-autonomous driving actions to improve driver understanding, trust, and performanceInternational Journal on Interactive Design and Manufacturing (IJIDeM), 2014
- Human Performance Consequences of Stages and Levels of AutomationHuman Factors: The Journal of the Human Factors and Ergonomics Society, 2013
- A Situation Awareness Assistant for Human Deep Space Exploration2013
- Managing workload in human–robot interaction: A review of empirical studiesComputers in Human Behavior, 2010
- The Red-Line of Workload: Theory, Research, and DesignProceedings of the Human Factors and Ergonomics Society Annual Meeting, 2008
- Supporting Real-Time Cognitive State Classification on a Mobile IndividualJournal of Cognitive Engineering and Decision Making, 2007
- The role of trust in automation relianceInternational Journal of Human-Computer Studies, 2003
- Dynamic adaptive autonomy in multi-agent systemsJournal of Experimental & Theoretical Artificial Intelligence, 2000
- Mixed-initiative interactionIEEE Intelligent Systems and their Applications, 1999
- Trust, control strategies and allocation of function in human-machine systemsErgonomics, 1992