Machine learning-assisted wearable sensing systems for speech recognition and interaction
Top Cited Papers
Open Access
- 10 March 2025
- journal article
- research article
- Published by Springer Nature in Nature Communications
- Vol. 16 (1) , 1-13
Abstract
The human voice stands out for its rich information transmission capabilities. However, voice communication is susceptible to interference from noisy environments and obstacles. Here, we propose a wearable wireless flexible skin-attached acoustic sensor (SAAS) capable of capturing the vibrations of vocal organs and skin movements, thereby enabling voice recognition and human-machine interaction (HMI) in harsh acoustic environments. This system utilizes a piezoelectric micromachined ultrasonic transducers (PMUT), which feature high sensitivity (-198 dB), wide bandwidth (10 Hz-20 kHz), and excellent flatness (±0.5 dB). Flexible packaging enhances comfort and adaptability during wear, while integration with the Residual Network (ResNet) architecture significantly improves the classification of laryngeal speech features, achieving an accuracy exceeding 96%. Furthermore, we also demonstrated SAAS’s data collection and intelligent classification capabilities in multiple HMI scenarios. Finally, the speech recognition system was able to recognize everyday sentences spoken by participants with an accuracy of 99.8% through a deep learning model. With advantages including a simple fabrication process, stable performance, easy integration, and low cost, SAAS presents a compelling solution for applications in voice control, HMI, and wearable electronics.Keywords
This publication has 67 references indexed in Scilit:
- Cloud‐Integrated Smart Nanomembrane Wearables for Remote Wireless Continuous Health Monitoring of Postpartum WomenAdvanced Science, 2024
- Health Monitoring via Heart, Breath, and Korotkoff Sounds by Wearable Piezoelectret PatchesAdvanced Science, 2023
- Electromyogram‐Based Lip‐Reading via Unobtrusive Dry Electrodes and Machine Learning MethodsSmall, 2023
- An Electret‐Powered Skin‐Attachable Auditory Sensor that Functions in Harsh Acoustic EnvironmentsAdvanced Materials, 2022
- Bionic Ultra‐Sensitive Self‐Powered Electromechanical Sensor for Muscle‐Triggered Communication ApplicationAdvanced Science, 2021
- Soft human–machine interfaces: design, sensing and stimulationInternational Journal of Intelligent Robotics and Applications, 2018
- Speech enhancement in dual-microphone mobile phones using Kalman filterApplied Acoustics, 2016
- Stretchable‐Rubber‐Based Triboelectric Nanogenerator and Its Application as Self‐Powered Body Motion SensorsAdvanced Functional Materials, 2015
- Eardrum‐Inspired Active Sensors for Self‐Powered Cardiovascular System Characterization and Throat‐Attached Anti‐Interference Voice RecognitionAdvanced Materials, 2015
- Materials and Optimized Designs for Human‐Machine Interfaces Via Epidermal ElectronicsAdvanced Materials, 2013