Augmented reality‐based telepresence in a robotic manipulation task: An experimental evaluation
Open Access
- 19 October 2023
- journal article
- research article
- Published by Institution of Engineering and Technology (IET) in IET Collaborative Intelligent Manufacturing
- Vol. 5 (4)
Abstract
A spectrum of control methods in human–robot interaction was investigated, ranging from direct control to telepresence with a virtual representation of the robot arm. A total of 24 participants used a setup that included a Franka Emika Panda robot arm, Varjo XR‐3 head‐mounted display, and Leap Motion Controller. Participants performed a box‐and‐block task using the bare hand (A), and under five gesture‐controlled robotic operation methods: direct sight (B), sight via video‐feedthrough (C), in a 3D telepresence environment with (D) and without (E) virtual representation of the robot arm, and using a 2D video feed (F). The number of grabbing attempts did not differ significantly between conditions, but local operation (B & C) yielded more transferred blocks than teleoperation (D–F). Teleoperation using a 3D presentation was advantageous compared to teleoperation using a 2D video feed, as demonstrated by lower peak forces and smaller range in gripper heights in conditions D and E compared to condition F, a finding supported by analyses of the head movement activity. Finally, the bare hand yielded the best performance and subjective ratings. In summary, teleoperation using a 3D presentation provided a smoother interaction than teleoperation with a 2D video feed. However, direct human interaction remains a benchmark yet to surpass.Keywords
This publication has 46 references indexed in Scilit:
- Augmented reality-aided tele-presence system for robot manipulation in industrial manufacturing2015
- Tool making, hand morphology and fossil homininsPhilosophical Transactions of the Royal Society B: Biological Sciences, 2013
- Predicting space telerobotic operator training performance from human spatial ability assessmentActa Astronautica, 2013
- Using Sensorimotor Contingencies for Prediction and Action Planning2012
- The Usability Metric for User ExperienceInteracting with Computers, 2010
- Test-Retest Reproducibility and Smallest Real Difference of 5 Hand Function Tests in Patients With StrokeNeurorehabilitation and Neural Repair, 2009
- TelepresenceHuman Factors: The Journal of the Human Factors and Ergonomics Society, 1998
- Adult Norms for the Box and Block Test of Manual DexterityAmerican Journal of Occupational Therapy, 1985
- The Analysis of StereopsisAnnual Review of Neuroscience, 1984
- Motion Parallax as an Independent Cue for Depth PerceptionPerception, 1979