A Comprehensive User Study on Augmented Reality-Based Data Collection Interfaces for Robot Learning
Open Access
- 11 March 2024
- conference paper
- Published by Association for Computing Machinery (ACM)
- p. 333-342
Abstract
Future versatile robots need the ability to learn new tasks and behaviors from demonstrations. Recent advances in virtual and augmented reality position these technologies as great candidates for the efficient and intuitive collection of large sets of demonstrations. While there are different possible approaches to control a virtual robot there has not yet been an evaluation of these control interfaces in regards to their efficiency and intuitiveness. These characteristics become particularly important when working with non-expert users and complex manipulation tasks. To this end, this work investigates five different interfaces to control a virtual robot in a comprehensive user study across various virtualized tasks in an AR setting. These interfaces include Hand Tracking, Virtual Kinesthetic Teaching, Gamepad and Motion Controller. Additionally, this work introduces Kinesthetic Teaching as a novel interface to control virtual robots in AR settings, where the virtual robot mimics the movement of a real robot manipulated by the user. This study reveals valuable insights into their usability and effectiveness. It shows that the proposed Kinesthetic Teaching interface significantly outperforms other interfaces in both objective and subjective metrics based on success rate, task completeness, and completion time and User Experience Questionnaires (UEQ+).Keywords
Funding Information
- Deutsche Forschungsgemeinschaft (448648559)
- China Scholarship Council (202106120036)
This publication has 40 references indexed in Scilit:
- Ego4D: Around the World in 3,000 Hours of Egocentric Video2022
- Advancing the Design of Visual Debugging Tools for Roboticists2022
- On Compositions of Transformations in Contrastive Self-Supervised Learning2021
- DexYCB: A Benchmark for Capturing Hand Grasping of Objects2021
- Toward Human-like Teleoperated Robot Motion: Performance and Perception of a Choreography-inspired Method in Static and Dynamic Tasks for Rapid Pose Selection of Articulated Robots2020
- DexPilot: Vision-Based Teleoperation of Dexterous Robotic Hand-Arm System2020
- Helping Robots Learn: A Human-Robot Master-Apprentice Model Using Demonstrations via Virtual Reality Teleoperation2020
- Towards a Virtual Reality Interface for Remote Robotic Teleoperation2019
- Robot Teleoperation with Augmented Reality Virtual Surrogates2019
- The YCB object and Model set: Towards common benchmarks for manipulation research2015