Autoencoding a Soft Touch to Learn Grasping from On‐Land to Underwater
Open Access
- 22 October 2023
- journal article
- research article
- Published by Wiley in Advanced Intelligent Systems
- Vol. 6 (1)
Abstract
Robots play a critical role as the physical agent of human operators in exploring the ocean. However, it remains challenging to grasp objects reliably while fully submerging under a highly pressurized aquatic environment with little visible light, mainly due to the fluidic interference on the tactile mechanics between the finger and object surfaces. This study investigates the transferability of grasping knowledge from on‐land to underwater via a vision‐based soft robotic finger that learns 6D forces and torques (FT) using a supervised variational autoencoder (SVAE). A high‐framerate camera captures the whole‐body deformations while a soft robotic finger interacts with physical objects on‐land and underwater. Results show that the trained SVAE model learns a series of latent representations of the soft mechanics transferable from land to water, presenting a superior adaptation to the changing environments against commercial FT sensors. Soft, delicate, and reactive grasping enabled by tactile intelligence enhances the gripper's underwater interaction with improved reliability and robustness at a much‐reduced cost, paving the path for learning‐based intelligent grasping to support fundamental scientific discoveries in environmental and ocean research.Keywords
Funding Information
- National Natural Science Foundation of China (62206119)
- Science, Technology and Innovation Commission of Shenzhen Municipality (ZDSYS20220527171403009, JCYJ20220818100417038)
- Guangdong Provincial Key Laboratory of Robotics and Intelligent Systems
This publication has 36 references indexed in Scilit:
- The Ocean One hands: An adaptive design for robust marine manipulationThe International Journal of Robotics Research, 2017
- Universal jamming grippers for deep-sea manipulation2016
- Soft Robotic Grippers for Biological Sampling on Deep ReefsSoft Robotics, 2016
- Benchmarking in Manipulation Research: Using the Yale-CMU-Berkeley Object and Model SetIEEE Robotics & Automation Magazine, 2015
- Representation Learning: A Review and New PerspectivesIEEE Transactions on Pattern Analysis and Machine Intelligence, 2013
- Sufficient dimension reduction and prediction in regressionPhilosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences, 2009
- Hand Posture Subspaces for Dexterous Robotic GraspingThe International Journal of Robotics Research, 2009
- Approximately Sufficient Statistics and Bayesian ComputationStatistical Applications in Genetics and Molecular Biology, 2008
- Reducing the Dimensionality of Data with Neural NetworksScience, 2006
- The AMADEUS dextrous subsea hand: design, modeling, and sensor processingIEEE Journal of Oceanic Engineering, 1999