High-Resolution 3-Dimensional Contact Deformation Tracking for FingerVision Sensor With Dense Random Color Pattern
- 23 February 2021
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Robotics and Automation Letters
- Vol. 6 (2) , 2147-2154
Abstract
Recent studies on vision-based tactile sensing have shown promising results on the perception of contact information, which could improve the performance of dexterous manipulations. However, 3-dimensional contact deformation tracking at a higher resolution is desired and remains a challenge for vision-based tactile sensors with monocular configurations. In this work, a similar hardware structure to our previous FingerVision sensor is adopted. The dot markers are replaced with a novel random color pattern as the sensor's tracking target and a dense optical flow algorithm is used to track the deformation of its elastic contact interface. This results in a more accurate 2-dimensional deformation field estimation at a higher resolution in comparison with that obtained using sparse dot markers. Additionally, the denser and more accurate deformation field enables depth estimation with better fidelity. To achieve depth estimation purely from the optical flow field, Gaussian density feature extraction and processing framework are proposed. The resulting depth map can be used independently as a tactile sensing modality, or jointly with the accurate in-plane displacement field as a more complete deformation tracking of contact interfaces for vision-based tactile sensors.Keywords
Funding Information
- Government of the Hong Kong Special Administrative Region (ITS-104-19FP)
This publication has 26 references indexed in Scilit:
- Fast Optical Flow Using Dense Inverse Search2016
- Measurement of shear and slip with a GelSight tactile sensor2015
- Microgeometry capture using an elastomeric sensorACM Transactions on Graphics, 2011
- Tactile sensing for dexterous in-hand manipulation in robotics—A reviewSensors and Actuators A: Physical, 2011
- Tactile Sensing—From Humans to HumanoidsIEEE Transactions on Robotics, 2010
- State-of-the-Art in Force and Tactile Sensing for Minimally Invasive SurgeryIEEE Sensors Journal, 2008
- Polymer based interfaces as bioinspired ‘smart skins’Advances in Colloid and Interface Science, 2005
- Advances in tactile sensors design/manufacturing and its impact on robotics applications – a reviewIndustrial Robot: the international journal of robotics research and application, 2005
- Tactile sensing in intelligent robotic manipulation – a reviewIndustrial Robot: the international journal of robotics research and application, 2005
- The Levenberg-Marquardt algorithm: Implementation and theory1978