Finger joint angle and gesture estimation under natural conditions with a soft printed electrode array
Open Access
- 1 October 2025
- journal article
- Published by AIP Publishing in APL Bioengineering
- Vol. 9 (4) , 046103
Abstract
Innovative methods for finger gesture recognition have been an active research area, with surface electromyography (sEMG) emerging as a promising approach in human-machine interface applications, especially when visual imaging is impractical. However, sEMG-based gesture recognition is highly susceptible to movement artifacts, individual muscle activation, and changes in hand position, making dynamic gesture recognition challenging. While progress has been made in sEMG data collection and analysis, most studies focus on controlled, static hand positions, limiting real-world applicability. This study integrates a soft wearable sEMG sensor, a Video-Vision-Transform model, and motion sensor-based training to predict finger joint angles and recognize gestures across both static and dynamic hand positions. Despite inter-subject variability, results demonstrate differentiation of finger angles and gestures. For the highly performing subject, recognition accuracy reached 0.85 for static and 0.87 for dynamic settings. This work advances sEMG-based gesture recognition, indicating stable performance across tested static and dynamic conditions, suggesting potential suitability for natural and real-world applications.Keywords
Funding Information
- European Research Council (101053186)
This publication has 34 references indexed in Scilit:
- Inkjet-printed fully customizable and low-cost electrodes matrix for gesture recognitionScientific Reports, 2021
- Data Augmentation of Surface Electromyography for Hand Gesture RecognitionSensors, 2020
- Hand-Gesture Recognition Based on EMG and Event-Based Camera Sensor Fusion: A Benchmark in Neuromorphic ComputingFrontiers in Neuroscience, 2020
- A normalisation approach improves the performance of inter-subject sEMG-based hand gesture recognition with a ConvNet2020
- Multi-channel electromyography-based mapping of spontaneous smilesJournal of Neural Engineering, 2020
- OpenPose: Realtime Multi-Person 2D Pose Estimation Using Part Affinity FieldsIEEE Transactions on Pattern Analysis and Machine Intelligence, 2019
- A Wearable High-Resolution Facial Electromyography for Long Term Recordings in Freely Behaving HumansScientific Reports, 2018
- Self-Recalibrating Surface EMG Pattern Recognition for Neuroprosthesis Control Based on Convolutional Neural NetworkFrontiers in Neuroscience, 2017
- Gesture recognition by instantaneous surface EMG imagesScientific Reports, 2016
- Characterization of a Benchmark Database for Myoelectric Movement ClassificationIEEE Transactions on Neural Systems and Rehabilitation Engineering, 2014