Shear-Based Grasp Control for Multifingered Underactuated Tactile Robotic Hands
- 21 April 2025
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Robotics
- Vol. 41 (15523098) , 3113-3128
Abstract
This paper presents a shear-based control scheme for grasping and manipulating delicate objects with a Pisa/IIT anthropomorphic SoftHand equipped with soft biomimetic tactile sensors on all five fingertips. These ‘microTac’ tactile sensors are miniature versions of the TacTip vision-based tactile sensor, and can extract precise contact geometry and force information at each fingertip for use as feedback into a controller to modulate the grasp while a held object is manipulated. Using a parallel processing pipeline, we asynchronously capture tactile images and predict contact pose and force from multiple tactile sensors. Consistent pose and force models across all sensors are developed using supervised deep learning with transfer learning techniques. We then develop a grasp control framework that uses contact force feedback from all fingertip sensors simultaneously, allowing the hand to safely handle delicate objects even under external disturbances. This control framework is applied to several grasp-manipulation experiments: first, retaining a flexible cup in a grasp without crushing it under changes in object weight; second, a pouring task where the center of mass of the cup changes dynamically; and third, a tactile-driven leader-follower task where a human guides a held object. These manipulation tasks demonstrate more human- like dexterity with underactuated robotic hands by using fast reflexive control from tactile sensing.Keywords
All Related Versions
Funding Information
- Horizon Europe Research and Innovation Program (101120823)
- Royal Society International Collaboration
This publication has 53 references indexed in Scilit:
- A Hybrid Approach for Extracting EMG signals by Filtering EEG Data for IoT Applications for Immobile PersonsWireless Personal Communications, 2020
- Touch driven controller and tactile features for physical interactionsRobotics and Autonomous Systems, 2020
- Soft Robotic GrippersAdvanced Materials, 2018
- The TacTip Family: Soft Optical Tactile Sensors with 3D-Printed Biomimetic MorphologiesSoft Robotics, 2018
- Tactile sensing in dexterous robot hands — ReviewRobotics and Autonomous Systems, 2015
- Finger contact sensing and the application in dexterous hand manipulationAutonomous Robots, 2015
- A real-time strategy for dexterous manipulation: Fingertips motion planning, force sensing and grasp stabilityRobotics and Autonomous Systems, 2012
- The Application of the Butterworth Low-Pass Digital Filter on Experimental Data Processing2011
- Tactile sensing for dexterous in-hand manipulation in robotics—A reviewSensors and Actuators A: Physical, 2011
- Optimization of grasping forces in handling of brittle objectsRobotics and Autonomous Systems, 2009