Virtual Reality-based Human-Robot Interaction for Remote Pick-and-Place Tasks
Open Access
- 11 March 2024
- conference paper
- Published by Association for Computing Machinery (ACM)
- p. 1148-1152
Abstract
Virtual Reality (VR) has emerged as a promising medium, enhancing human-robot interaction by offering a more immersive and intuitive interface. This paper presents a novel approach utilizing VR, particularly the Meta Quest 2 device, as an interface for remote control of a robot performing a pick-and-place task in a proxy data center environment. A user interface was created in VR, enabling users to control the Fetch Mobile Manipulator robot and monitor its pose for secure and safe remote operation. This work integrates virtual reality, computer vision, and human-robot interaction methodologies. The system demonstrates the effectiveness of this VR-based human-robot interaction approach, showcasing its potential to enhance productivity and safety in industrial applications involving remote robot control.Keywords
Funding Information
- Cisco (75434857)
This publication has 16 references indexed in Scilit:
- Virtual reality in human-robot interaction: Challenges and benefitsElectronic Research Archive, 2023
- Mixed-Reality-Enhanced Human–Robot Interaction with an Imitation-Based Mapping Approach for Intuitive Teleoperation of a Robotic Arm-Hand SystemApplied Sciences, 2022
- GazeEMD: Detecting Visual Intention in Gaze-Based Human-Robot InteractionRobotics, 2021
- Human-Robot Interaction in Social Robotics2017
- Social Robots2017
- Human–Robot InteractionHuman Factors: The Journal of the Human Factors and Ergonomics Society, 2016
- Robotics Technology in Mental Health Care2016
- Socially Assistive RoboticsIEEE Robotics & Automation Magazine, 2011
- Human–Robot Interaction: A SurveyFoundations and Trends® in Human-Computer Interaction, 2008
- Common metrics for human-robot interaction2006