Deep Learning‐Assisted Electronic Skin System Capable of Capturing Spatiotemporal and Mechanical Features of Social Touch to Enhance Human–Robot Emotion Recognition
Open Access
Abstract
In human interactions, social touch communication is widely used to convey emotions, emphasizing its critical role in advancing human–robot interactions by enabling robots to understand and respond to human emotions, thereby significantly enhancing their service capabilities. However, the challenge is to dynamically capture social touch with sufficient spatiotemporal and mechanical resolution for deep haptic data analysis. This study presents a robotic system with flexible electronic skin and a high‐frequency signal circuit, utilizing deep neural networks to recognize social touch emotions. The electronic skin, made from double cross‐linked ionogels and microstructured arrays, has a low force detection threshold (8 Pa) and a wide perception range (0–150 kPa), enhancing the mechanical resolution of touch signals. By incorporating a high‐speed readout circuit capable of capturing spatiotemporal features of social touch gesture information at 30 Hz, the system facilitates precise analysis of touch interactions. A 3D convolutional neural network with a Squeeze‐and‐Excitation Attention module achieves 87.12% accuracy in recognizing social touch gestures, improving the understanding of emotions conveyed through touch. The effectiveness of the system is validated through interactive demonstrations with robotic dogs and humanoid robots, demonstrating its potential to enhance the emotional intelligence of robots.Keywords
This publication has 49 references indexed in Scilit:
- Polymer ionogels and their application in flexible ionic devicesSmartMat, 2024
- Microstructured Polyelectrolyte Elastomer‐Based Ionotronic Sensors with High Sensitivities and Excellent Stability for Artificial SkinsAdvanced Materials, 2023
- Micropyramid Array Bimodal Electronic Skin for Intelligent Material and Surface Shape Perception Based on Capacitive SensingAdvanced Science, 2023
- Stretchable hybrid platform‐enabled interactive perception of strain sensing and visualizationSmartMat, 2023
- Self‐Powered and Interface‐Independent Tactile Sensors Based on Bilayer Single‐Electrode Triboelectric Nanogenerators for Robotic Electronic SkinAdvanced Intelligent Systems, 2021
- Cutaneous Ionogel Mechanoreceptors for Soft Machines, Physiological Sensing, and Amputee ProsthesesAdvanced Materials, 2021
- Highly Sensitive Capacitive Pressure Sensor Based on a Micropyramid Array for Health and Motion MonitoringAdvanced Electronic Materials, 2021
- Recent Progress in Flexible Tactile Sensors for Human‐Interactive Systems: From Sensors to Advanced ApplicationsAdvanced Materials, 2021
- Wearable Sensors‐Enabled Human–Machine Interaction Systems: From Design to ApplicationAdvanced Functional Materials, 2020
- Highly Conductive, Scalable, and Machine Washable Graphene‐Based E‐Textiles for Multifunctional Wearable Electronic ApplicationsAdvanced Functional Materials, 2020