Evaluation of Human-Robot Interfaces based on 2D/3D Visual and Haptic Feedback for Aerial Manipulation
Authors:
- Julien MelletJMJulien Mellet
- Mike AllenspachMAMike Allenspach
- Eugenio CuniatoECEugenio Cuniato
- Claudio PacchierottiCPClaudio Pacchierotti
- Roland SiegwartRSRoland Siegwart
- Marco TognonMTMarco Tognon
Preprint
Abstract
Most telemanipulation systems for aerial robots provide the operator with only 2D screen visual information. The lack of richer information about the robot's status and environment can limit human awareness and, in turn, task performance. While the pilot's experience can often compensate for this reduced flow of information, providing richer feedback is expected to reduce the cognitive workload and offer a more intuitive experience overall. This work aims to understand the significance of providing additional pieces of information during aerial telemanipulation, namely (i) 3D immersive visual feedback about the robot's surroundings through mixed reality (MR) and (ii) 3D haptic feedback about the robot interaction with the environment. To do so, we developed a human-robot interface able to provide this information. First, we demonstrate its potential in a real-world manipulation task requiring sub-centimeter-level accuracy. Then, we evaluate the individual effect of MR vision and haptic feedback on both dexterity and workload through a human subjects study involving a virtual block transportation task. Results show that both 3D MR vision and haptic feedback improve the operator's dexterity in the considered teleoperated aerial interaction tasks. Nevertheless, pilot experience remains the most significant factor.Keywords
All Related Versions
This publication has 33 references indexed in Scilit:
- A haptic-feedback virtual reality system to improve the Box and Block Test (BBT) for upper extremity motor function assessmentVirtual Reality, 2022
- AeroVr: Virtual Reality-based Teleoperation with Tactile Feedback for Aerial Manipulation2019
- Survey on Aerial Manipulator: System, Modeling, and ControlRobotica, 2019
- Combining Wearable Finger Haptics and Augmented Reality: User Evaluation Using an External Camera and the Microsoft HoloLensIEEE Robotics and Automation Letters, 2018
- Aerial Manipulation: A Literature ReviewIEEE Robotics and Automation Letters, 2018
- Enabling technologies for autonomous MAV operationsProgress in Aerospace Sciences, 2017
- Comparing Objective and Subjective Metrics Between Physical and Virtual Tasks2016
- An experimental study about haptic feedback in robotic surgery: may visual feedback substitute tactile feedback?Journal of Robotic Surgery, 2015
- Real-Time Photorealistic Virtualized Reality Interface for Remote Mobile Robot Control2011
- When Feeling Is More Important Than Seeing in Sensorimotor AdaptationCurrent Biology, 2002