Sensing and Reconstruction of 3-D Deformation on Pneumatic Soft Robots
- 7 May 2021
- journal article
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE/ASME Transactions on Mechatronics
- Vol. 26 (4) , 1877-1885
Abstract
Real-time proprioception is a challenging problem for soft robots, which have virtually infinite degrees of freedom in body deformation. When multiple actuators are used, it becomes more difficult as deformation can also occur on actuators caused by interaction between each other. To tackle this problem, we present a method in this article to sense and reconstruct 3-D deformation on pneumatic soft robots by first integrating multiple low-cost sensors inside the chambers of pneumatic actuators and then using machine learning to convert the captured signals into shape parameters of soft robots. An exterior motion capture system is employed to generate the datasets for both training and testing. With the help of good shape parameterization, the 3-D shape of a soft robot can be accurately reconstructed from signals obtained from multiple sensors. We demonstrate the effectiveness of this approach on two soft robot designs-a robotic joint and a deformable membrane. After parameterizing the deformation of these soft robots into compact shape parameters, we can effectively train the neural networks to reconstruct the 3-D deformation from the sensor signals. The sensing and shape prediction pipeline can run at 50 Hz in real time on a consumer-level device.Keywords
All Related Versions
Funding Information
- CUHK Technology and Business Development Fund (TBF19ENG005)
This publication has 31 references indexed in Scilit:
- Bending angle prediction and control of soft pneumatic actuators with embedded flex sensors – A data-driven approachMechatronics, 2018
- GelSight: High-Resolution Robot Tactile Sensors for Estimating Geometry and ForceSensors, 2017
- Shape-independent hardness estimation using deep learning and a GelSight tactile sensor2017
- Sensing the motion of bellows through changes in mutual inductance2016
- DefSense2016
- Improving Soft Pneumatic Actuator fingers through integration of soft sensors, position and force control, and rigid fingernails2016
- A composite soft bending actuation module with integrated curvature sensing2016
- Macrobend optical sensing for pose measurement in soft robot armsSmart Materials and Structures, 2015
- Neural Network and Jacobian Method for Solving the Inverse Statics of a Cable-Driven Soft Arm With Nonconstant CurvatureIEEE Transactions on Robotics, 2015
- Estimating 3-D rigid body transformations: a comparison of four major algorithmsMachine Vision and Applications, 1997