DenseTact 2.0: Optical Tactile Sensor for Shape and Force Reconstruction
Authors:
- Won Kyung DoWDWon Kyung Do
- Bianca JurewiczBJBianca Jurewicz
- Monroe Kennedy IiiMIMonroe Kennedy Iii
Preprint
Abstract
Collaborative robots stand to have an immense impact on both human welfare in domestic service applications and industrial superiority in advanced manufacturing with dexterous assembly. The outstanding challenge is providing robotic fingertips with a physical design that makes them adept at performing dexterous tasks that require high-resolution, calibrated shape reconstruction and force sensing. In this work, we present DenseTact 2.0, an optical-tactile sensor capable of visualizing the deformed surface of a soft fingertip and using that image in a neural network to perform both calibrated shape reconstruction and 6-axis wrench estimation. We demonstrate the sensor accuracy of 0.3633mm per pixel for shape reconstruction, 0.410N for forces, 0.387Nmm for torques, and the ability to calibrate new fingers through transfer learning, which achieves comparable performance with only 12% of the non-transfer learning dataset size.Keywords
All Related Versions
This publication has 13 references indexed in Scilit:
- BinsFormer: Revisiting Adaptive Bins for Monocular Depth EstimationIEEE Transactions on Image Processing, 2024
- GelSlim 3.0: High-Resolution Measurement of Shape, Force and Slip in a Compact Tactile-Sensing Finger2022
- A soft thumb-sized vision-based sensor with accurate all-round force perceptionNature Machine Intelligence, 2022
- Multidimensional Tactile Sensor with a Thin Compound Eye-Inspired Imaging SystemSoft Robotics, 2021
- High-Resolution 3-Dimensional Contact Deformation Tracking for FingerVision Sensor With Dense Random Color PatternIEEE Robotics and Automation Letters, 2021
- Soft, Round, High Resolution Tactile Fingertip Sensors for Dexterous Robotic Manipulation2020
- DIGIT: A Novel Design for a Low-Cost Compact High-Resolution Tactile Sensor With Application to In-Hand ManipulationIEEE Robotics and Automation Letters, 2020
- Dynamically Reconfigurable Tactile Sensor for Robotic ManipulationIEEE Robotics and Automation Letters, 2020
- Shear, Torsion and Pressure Tactile Sensor via Plastic Optofiber Guided ImagingIEEE Robotics and Automation Letters, 2020
- A flexible capacitive tactile sensing array with floating electrodesJournal of Micromechanics and Microengineering, 2009