GelStereo BioTip: Self-Calibrating Bionic Fingertip Visuotactile Sensor for Robotic Manipulation
- 13 December 2023
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE/ASME Transactions on Mechatronics
- Vol. 29 (4) , 2451-2462
Abstract
High-resolution visuotactile sensors are often bulky and have flat contact shapes, making it difficult to integrate into dexterous multifinger fingertips and perform manipulation tasks smoothly. In this article, we present a soft, low-cost, biomimetic fingertip-sized visuotactile sensor, which can perceive high-precision 3-D surface deformation. This novel sensor, named GelStereo BioTip, adopts stereo vision system to robustly acquire 3-D deformation information on multicurvature contact surfaces. In particular, a self-calibrating refractive stereo ray tracing modeling method is proposed to solve the problem of ray refraction on multimedium and multicurvature refractive surfaces in the binocular reconstruction system. GelStereo BioTip has an overall spatial resolution of 1.2 mm, a shape measurement accuracy of less than 0.28 mm over a range of 0–5 mm for numerous distinct contacts with varying contact area. We integrate the bionic fingertips into a dexterous robotic hand for validation, and the proposed bionic fingertip concept can be seamlessly transferred to a variety of robotic manipulators.Keywords
Funding Information
- National Key Research and Development Program of China (2018AAA0103003)
- National Natural Science Foundation of China (62273342, 62122087)
- Beijing Natural Science Foundation (4222055)
This publication has 32 references indexed in Scilit:
- DenseTact 2.0: Optical Tactile Sensor for Shape and Force Reconstruction2023
- In-Hand Pose Estimation Using Hand-Mounted RGB Cameras and Visuotactile SensorsIEEE Access, 2023
- A soft thumb-sized vision-based sensor with accurate all-round force perceptionNature Machine Intelligence, 2022
- SwingBot: Learning Physical Features from In-hand Tactile Exploration for Dynamic Swing-up Manipulation2020
- GelTip: A Finger-shaped Optical Tactile Sensor for Robotic Manipulation2020
- OmniTact: A Multi-Directional High-Resolution Touch Sensor2020
- Soft, Round, High Resolution Tactile Fingertip Sensors for Dexterous Robotic Manipulation2020
- Visuotactile Sensors With Emphasis on GelSight Sensor: A ReviewIEEE Sensors Journal, 2020
- Tactile perception and working memory in rats and humansProceedings of the National Academy of Sciences, 2014
- Coding and use of tactile signals from the fingertips in object manipulation tasksNature Reviews Neuroscience, 2009