Evaluation of Human-Robot Interfaces Based on 2D/3D Visual and Haptic Feedback for Aerial Manipulation
Open Access
- 18 September 2025
- journal article
- research article
- Published by Springer Nature in Journal of Intelligent & Robotic Systems
- Vol. 111 (3) , 1-16
Abstract
Most telemanipulation systems for aerial robots provide the operator with only 2D screen visual information. The lack of richer information about the robot’s status and environment can limit human awareness and, in turn, task performance. While the pilot’s experience can often compensate for this reduced flow of information, providing richer feedback is expected to reduce the cognitive workload and offer a more intuitive experience overall. This work aims to understand the significance of providing additional pieces of information during aerial telemanipulation, namely (i) 3D immersive visual feedback about the robot’s surroundings through mixed reality (MR) and (ii) 3D haptic feedback about the robot interaction with the environment. To do so, we developed a human-robot interface able to provide this information. First, we demonstrate its potential in a real-world manipulation task requiring sub-centimeter-level accuracy. Then, we evaluate the individual effect of MR vision and haptic feedback on both dexterity and workload through a human subjects study involving a virtual block transportation task. Results show that both 3D MR vision and haptic feedback improve the operator’s dexterity in the considered teleoperated aerial interaction tasks. Nevertheless, pilot experience remains the most significant factor.Keywords
All Related Versions
Funding Information
- HORIZON EUROPE Marie Sklodowska-Curie Actions (953454)
This publication has 53 references indexed in Scilit:
- A haptic-feedback virtual reality system to improve the Box and Block Test (BBT) for upper extremity motor function assessmentVirtual Reality, 2022
- Size Perception of Augmented Objects by Different AR Displays2019
- Enabling technologies for autonomous MAV operationsProgress in Aerospace Sciences, 2017
- Comparing Objective and Subjective Metrics Between Physical and Virtual Tasks2016
- An experimental study about haptic feedback in robotic surgery: may visual feedback substitute tactile feedback?Journal of Robotic Surgery, 2015
- Full Factorial Designs2014
- Real-Time Photorealistic Virtualized Reality Interface for Remote Mobile Robot Control2011
- The value of haptic feedback in conventional and robot-assisted minimal invasive surgery and virtual reality training: a current reviewSurgical Endoscopy, 2009
- Applied Regression Analysis1998
- Development of NASA-TLX (Task Load Index): Results of Empirical and Theoretical Research1988