Electrospun Surface-Modified Epidermal Strain Sensors Enable Silent Speech and Hand Gesture Recognition for Virtual Reality Interaction
Open Access
- 25 April 2026
- journal article
- research article
- Published by MDPI AG in Nanomaterials
- Vol. 16 (9) , 520
Abstract
Voice disorders severely limit verbal communication, creating a need for intuitive assistive technologies. To meet this need, we present epidermal strain sensors that capture strain signals during silent speech and hand gesture. A thin electrospun nanofiber layer integrated onto commercial polyurethane films guides uniform, controlled microcrack formation in screen-printed carbon conductive paths, achieving a gauge factor up to 243 over 0–40% strain. Signals from the seven-channel strain sensor array are recognized by a hybrid neural network that combines convolutional and Transformer architectures, reaching over 98% accuracy. The recognized outputs are rendered in virtual reality (VR), enabling intuitive, real-time communication. Moreover, the approach simplifies fabrication by enabling crack-based strain sensing with only a thin electrospun surface layer on commercial polyurethane films, eliminating the need for thick freestanding electrospun substrates. This cost-effective approach addresses limitations of conventional electrospun substrates by minimizing the thickness of the electrospun layer, thereby shortening the electrospinning time. Overall, the work demonstrates a method for translating natural non-verbal expressions into speech and text in VR, with promising applications in healthcare and assistive communication.Keywords
Funding Information
- National Natural Science Foundation of China (52405598)
- National Natural Science Foundation of China (52375548)
- China Postdoctoral Science Foundation (BX20220251)
- Basic Research Open Project of Shandong Laboratory of Advanced Materials and Green Manufacturing at Yantai (AMGM2024F34)
This publication has 39 references indexed in Scilit:
- A Highly Permeable and Three-Dimensional Integrated Electronic System for Wearable Human–Robot InteractionNano-Micro Letters, 2026
- Mandarin speech reconstruction from surface electromyography based on generative adversarial networksMedicine in Novel Technology and Devices, 2025
- Breathable, superhydrophobic and multifunctional Janus nanofibers for dual-mode passive thermal management/facial expression recognition with deep learningChemical Engineering Journal, 2025
- Shape‐Reconfigurable Crack‐Based Strain Sensor with Ultrahigh and Tunable SensitivityAdvanced Functional Materials, 2025
- Prosodic Preferences of Surface Electromyography-based Subvocal Speech for People With LaryngectomyJournal of Voice, 2024
- 3D Printed Electronic Skin for Strain, Pressure and Temperature SensingAdvanced Functional Materials, 2024
- Heterogeneous Structure Omnidirectional Strain Sensor Arrays With Cognitively Learned Neural NetworksAdvanced Materials, 2023
- Geometrical and electrical modulation of cracked metal films based on metal nanowire/elastomer composites for high-performance wearable strain sensingComposites Science and Technology, 2022
- Crack engineering boosts the performance of flexible sensorsView, 2022
- Fabrication of Large‐Area Bimodal Sensors by All‐Inkjet‐PrintingAdvanced Materials Technologies, 2019