DexPilot: Vision-Based Teleoperation of Dexterous Robotic Hand-Arm System
Authors:
Top Cited Papers
- 1 May 2020
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 9164-9170
Abstract
Teleoperation offers the possibility of imparting robotic systems with sophisticated reasoning skills, intuition, and creativity to perform tasks. However, teleoperation solutions for high degree-of-actuation (DoA), multi-fingered robots are generally cost-prohibitive, while low-cost offerings usually offer reduced degrees of control. Herein, a low-cost, depth-based teleoperation system, DexPilot, was developed that allows for complete control over the full 23 DoA robotic system by merely observing the bare human hand. DexPilot enabled operators to solve a variety of complex manipulation tasks that go beyond simple pick-and-place operations and performance was measured through speed and reliability metrics. DexPilot cost-effectively enables the production of high dimensional, multi-modality, state-action data that can be leveraged in the future to learn sensorimotor policies for challenging manipulation tasks. The videos of the experiments can be found at https://sites.google.com/view/dex-pilot.Keywords
All Related Versions
This publication has 22 references indexed in Scilit:
- Analysis of human–robot interaction at the DARPA Robotics Challenge FinalsThe International Journal of Robotics Research, 2017
- Real-Time Continuous Pose Recovery of Human Hands Using Convolutional NetworksACM Transactions on Graphics, 2014
- DART: Dense Articulated Real-Time Tracking2014
- Real-time hand-tracking with a color glove2009
- Coding and use of tactile signals from the fingertips in object manipulation tasksNature Reviews Neuroscience, 2009
- Transcontinental Telesurgical Nephrectomy Using the da Vinci Robot in a Porcine ModelUrology, 2008
- Model-based hand tracking using a hierarchical Bayesian filterIEEE Transactions on Pattern Analysis and Machine Intelligence, 2006
- Algorithm 733: TOMP–Fortran modules for optimal control calculationsACM Transactions on Mathematical Software, 1994
- Roles of glabrous skin receptors and sensorimotor memory in automatic control of precision grip when lifting rougher or more slippery objectsExperimental Brain Research, 1984
- Tactile sensory coding in the glabrous skin of the human handTrends in Neurosciences, 1983