FunctionalGrasp: Learning Functional Grasp for Robots via Semantic Hand-Object Representation
- 5 April 2023
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Robotics and Automation Letters
- Vol. 8 (5) , 3094-3101
Abstract
Successful grasp is an important and long-standing issue for robots to interact with the real world. Most recent studies have devoted more attention to stable grasp rather than functional grasp, which cannot guarantee task-oriented postgrasp manipulation. To achieve human-like functional grasp, a semantic representation of functional hand-object interaction is introduced without labeling 3D hand poses, and a novel coarse-to-fine grasp generation network is designed to model this hand-object interaction. First, a coarse grasp is generated by combining the global hand pose and hand grasp type. Then, the fine pose will be optimized by guiding each finger to focus on the corresponding functional region of the object. Experimental results demonstrate the effectiveness of our method in achieving functional grasps for dexterous hands in the absence of high-DoF grasp poses annotation of the hand. The project website is: https://github.com/zhangyb1008/FunctionalGrasp .Keywords
Funding Information
- National Natural Science Foundation of China (61873046, U1708263)
This publication has 38 references indexed in Scilit:
- Grasp Pose Detection in Point CloudsThe International Journal of Robotics Research, 2017
- Learning partial power grasp with task-specific contact2016
- The Role of the Thumb: Study of Finger Motion in Grasping and Reachability Space in Human and Robotic HandsIEEE Transactions on Systems, Man, and Cybernetics: Systems, 2016
- The GRASP Taxonomy of Human Grasp TypesIEEE Transactions on Human-Machine Systems, 2015
- On computing task-oriented graspsRobotics and Autonomous Systems, 2015
- Robot grasp planning based on demonstrated grasp strategiesThe International Journal of Robotics Research, 2014
- From caging to graspingThe International Journal of Robotics Research, 2012
- Synthesizing grasp configurations with specified contact regionsThe International Journal of Robotics Research, 2010
- Quantitative analysis of finger motion coordination in hand manipulative and gestic actsHuman Movement Science, 2004
- On computing three-finger force-closure grasps of 2-d and 3-d objectsIEEE Transactions on Robotics and Automation, 2003