Human-Robot Team Performance Compared to Full Robot Autonomy in 16 Real-World Search and Rescue Missions: Adaptation of the DARPA Subterranean Challenge
Open Access
- 3 December 2024
- journal article
- Published by Association for Computing Machinery (ACM) in ACM Transactions on Human-Robot Interaction
- Vol. 14 (1) , 1-30
Abstract
Human operators in human-robot teams are commonly perceived to be critical for mission success. To explore the direct and perceived impact of operator input on task success and team performance, 16 real-world missions (10 h) were conducted based on the DARPA Subterranean Challenge. Missions involved deploying a heterogeneous team of robots to locate and identify artefacts such as climbing rope, drills and a mannequin representing a human survivor. Two conditions were evaluated: human operators that could control the robot team with state-of-the-art autonomy (Human-Robot Team) compared to autonomous missions without human operator input (Robot-Autonomy). Human interventions included creating waypoints to prioritise high-yield areas, and to navigate through error-prone spaces. Human-Robot Teams were often in directed autonomy mode (70% of mission time), found more items ( \(+\) 10.52%), traversed more distance ( \(+\) 12.71%), covered more unique ground ( \(+\) 10.56%), and longer time between safety-related events (34%). In routine conditions, both condition scores were comparable for artefacts, distance and coverage. Human-Robot Teams were faster at finding the first artefact but slower to respond to information from the robot team. Overall, operators contribute to mission-based outcomes, help to overcome environmental situations that can impede progress, and can assist robots to recover faster from difficult events.
Keywords
All Related Versions
This publication has 47 references indexed in Scilit:
- A Review of NASA Human-Robot Interaction in SpaceCurrent Robotics Reports, 2021
- Impact of Heterogeneity and Risk Aversion on Task Allocation in Multi-Agent TeamsIEEE Robotics and Automation Letters, 2021
- Understanding human-robot teams in light of all-human teams: Aspects of team interaction and shared cognitionInternational Journal of Human-Computer Studies, 2020
- Investigating Human-Robot Teams for Learning-Based Semi-autonomous Control in Urban Search and Rescue EnvironmentsJournal of Intelligent & Robotic Systems, 2018
- Common Metrics to Benchmark Human-Machine Teams (HMT): A ReviewIEEE Access, 2018
- Perspectives on Human-Robot Team Performance from an Evaluation of the DARPA Robotics Challenge2018
- Human–automation interaction for multiple robot control: the effect of varying automation assistance and individual differences on operator performanceErgonomics, 2018
- A literature review on the levels of automation during the years. What are the different taxonomies that have been proposed?Applied Ergonomics, 2016
- Analysis of Human‐robot Interaction at the DARPA Robotics Challenge TrialsJournal of Field Robotics, 2015
- Robotic Urban Search and Rescue: A Survey from the Control PerspectiveJournal of Intelligent & Robotic Systems, 2013