DeepTPA-Net: A Deep Triple Attention Network for sEMG-Based Hand Gesture Recognition
Open Access
- 5 September 2023
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Access
- Vol. 11, 96797-96807
Abstract
The use of hand gestures for human-computer interaction (HCI) has gained popularity due to its ability to provide natural and intuitive communication in human dialogues. Hand gesture recognition (HGR) using surface electromyography (sEMG) signals is more reliable and user-friendly than traditional computer vision-based methods. This study proposes a deep network named DeepTPA-Net that utilizes multi-channel sEMG signals to recognize hand gestures. DeepTPA-Net employs a ResNet50 network as an automated feature extractor and a novel triple attention (3Attn) block that connects spatial, temporal, and channel attention modules in parallel to signify important features for HGR. We evaluated the performance of DeepTPA-Net using five publicly available benchmark sEMG hand gesture datasets, including CapgMyo DB-a, Csl-hdemg, NinaPro DB1, NinaPro DB2, and SeNic. The effectiveness of the proposed 3Attn block for HGR is demonstrated through a performance comparison with other attention mechanisms. We compared the performance of DeepTPA-Net with various baseline models, including its variations and other existing methods. The results show that DeepTPA-Net significantly outperforms the baseline models for all five benchmark datasets, indicating the superiority of DeepTPA-Net for sEMG-based HGR.Keywords
Funding Information
- National Science Foundation (OIA-1757207)
- Institute for Complex Additive Systems Analysis (ICASA) of the New Mexico Institute of Mining and Technology
This publication has 47 references indexed in Scilit:
- Advancing Muscle-Computer Interfaces with High-Density Electromyography2015
- Characterization of a Benchmark Database for Myoelectric Movement ClassificationIEEE Transactions on Neural Systems and Rehabilitation Engineering, 2014
- Vision based hand gesture recognition for human computer interaction: a surveyArtificial Intelligence Review, 2012
- Building the Ninapro database: A resource for the biorobotics community2012
- Recognition of grasp types through principal components of DWT based EMG features2011
- Fuzzy Approximate Entropy Analysis of Chaotic and Natural Complex Systems: Detecting Muscle Fatigue Using Electromyography SignalsAnnals of Biomedical Engineering, 2010
- Using sample entropy for automated sign language recognition on sEMG and accelerometer dataMedical & Biological Engineering & Computing, 2009
- Measuring complexity using FuzzyEn, ApEn, and SampEnMedical Engineering & Physics, 2008
- Moving approximate entropy applied to surface electromyographic signalsBiomedical Signal Processing and Control, 2008
- Gesture Recognition: A SurveyIEEE Transactions on Systems, Man and Cybernetics, Part C (Applications and Reviews), 2007