An Intelligent Robotic System Capable of Sensing and Describing Objects Based on Bimodal, Self‐Powered Flexible Sensors
Authors:
- 24 August 2023
- journal article
- research article
- Published by Wiley in Advanced Functional Materials
- Vol. 33 (41)
Abstract
This study presents an intelligent soft robotic system capable of perceiving, describing, and sorting objects based on their physical properties. This work introduces a bimodal self‐powered flexible sensor (BSFS) based on the triboelectric nanogenerator and giant magnetoelastic effect. The BSFS features a simplified structure comprising a magnetoelastic conductive film and a packaged liquid metal coil. The BSFS can precisely detect and distinguish touchless and tactile models, with a response time of 10 ms. By seamlessly integrating the BSFSs into the soft fingers, this study realizes an anthropomorphic soft robotic hand with remarkable multimodal perception capabilities. The touchless signals provide valuable insights into object shape and material composition, while the tactile signals offer precise information regarding surface roughness. Utilizing a convolutional neural network (CNN), this study integrates all sensing information, resulting in an intelligent soft robotic system that accurately describes objects based on their physical properties, including materials, surface roughness, and shapes, with an accuracy rate of up to 97%. This study may lay a robotic foundation for the hardware of the general artificial intelligence with capacities to interpret and interact with the physical world, which also serves as an interface between artificial intelligence and soft robots.Keywords
Funding Information
- National Natural Science Foundation of China (61822303, T2121003, 91848206)
- National Key Research and Development Program of China (2020YFB1313003)
This publication has 54 references indexed in Scilit:
- Stretching and Twisting Sensing With Liquid-Metal Strain Gauges Printed on Silicone ElastomersIEEE Sensors Journal, 2015
- A 3D-printed, functionally graded soft robot powered by combustionScience, 2015
- Design, fabrication and control of soft robotsNature, 2015
- Stretchable, Transparent, Ultrasensitive, and Patchable Strain Sensor for Human–Machine Interfaces Comprising a Nanohybrid of Carbon Nanotubes and Conductive ElastomersACS Nano, 2015
- Tunable Piezoresistivity of Nanographene Films for Strain SensingACS Nano, 2015
- Dual functional transparent film for proximity and pressure sensingNano Research, 2014
- Giant Tunneling Piezoresistance of Composite Elastomers with Interlocked Microdome Arrays for Ultrasensitive and Multimodal Electronic SkinsACS Nano, 2014
- Molecular mechanisms of mechanotransduction in mammalian sensory neuronsNature Reviews Neuroscience, 2011
- Highly sensitive flexible pressure sensors with microstructured rubber dielectric layersNature Materials, 2010
- Human tactile perception as a standard for artificial tactile sensing—a reviewThe International Journal of Medical Robotics and Computer Assisted Surgery, 2004