GELLO: A General, Low-Cost, and Intuitive Teleoperation Framework for Robot Manipulators
Authors:
Top Cited Papers
- 14 October 2024
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 12156-12163
Abstract
Humans can teleoperate robots to accomplish complex manipulation tasks. Imitation learning has emerged as a powerful framework that leverages human teleoperated demonstrations to teach robots new skills. However, the performance of the learned policies is bottlenecked by the quality, scale, and variety of the demonstration data. In this paper, we aim to lower the barrier to collecting large and high-quality human demonstration data by proposing a GEneraL framework for building LOw-cost and intuitive teleoperation systems for robotic manipulation (GELLO). Given a target robot arm, we build a GELLO controller device that has the same kinematic structure as the target arm, leveraging 3D-printed parts and economical off-the-shelf motors. GELLO is easy to build and intuitive to use. Through an extensive user study, we show that GELLO enables more reliable and efficient demonstration collection compared to other cost efficient teleoperation devices commonly used in the imitation learning literature such as virtual reality controllers and 3D spacemouses. We further demonstrate the capabilities of GELLO for performing complex bi-manual and contact-rich manipulation tasks. To make GELLO accessible to everyone, we have designed and built GELLO systems for 3 commonly used robotic arms: Franka, UR5, and xArm. All software and hardware are open-sourced and can be found on our website: https://wuphilipp.github.io/gello/.Keywords
All Related Versions
This publication has 41 references indexed in Scilit:
- DexMV: Imitation Learning for Dexterous Manipulation from Human Videos2022
- Controlling Ocean One: Human–robot collaboration for deep‐sea manipulationJournal of Field Robotics, 2020
- A Scaled Bilateral Teleoperation System for Robotic-Assisted Surgery with Time DelayJournal of Intelligent & Robotic Systems, 2018
- Design, prototyping and testing of a modular small-sized underwater robotic arm controlled through a Master-Slave approachOcean Engineering, 2018
- History of robotic surgery : From AESOP® and ZEUS® to da Vinci®Journal of Visceral Surgery, 2011
- A survey of robot learning from demonstrationRobotics and Autonomous Systems, 2009
- Springer Handbook of Robotics2008
- Discriminative and adaptive imitation in uni-manual and bi-manual tasksRobotics and Autonomous Systems, 2006
- Is imitation learning the route to humanoid robots?Trends in Cognitive Sciences, 1999
- Stability and transparency in bilateral teleoperationIEEE Transactions on Robotics and Automation, 1993