Big data in myoelectric control: large multi-user models enable robust zero-shot EMG-based discrete gesture recognition
Authors:
Open Access
- 23 September 2024
- journal article
- research article
- Published by Frontiers Media SA in Frontiers in Bioengineering and Biotechnology
- Vol. 12, 1463377
Abstract
Myoelectric control, the use of electromyogram (EMG) signals generated during muscle contractions to control a system or device, is a promising input, enabling always-available control for emerging ubiquitous computing applications. However, its widespread use has historically been limited by the need for user-specific machine learning models because of behavioural and physiological differences between users. Leveraging the publicly available 612-user EMG-EPN612 dataset, this work dispels this notion, showing that true zero-shot cross-user myoelectric control is achievable without user-specific training. By taking a discrete approach to classification (i.e., recognizing the entire dynamic gesture as a single event), a classification accuracy of 93.0% for six gestures was achieved on a set of 306 unseen users, showing that big data approaches can enable robust cross-user myoelectric control. By organizing the results into a series of mini-studies, this work provides an in-depth analysis of discrete cross-user models to answer unknown questions and uncover new research directions. In particular, this work explores the number of participants required to build cross-user models, the impact of transfer learning for fine-tuning these models, and the effects of under-represented end-user demographics in the training data, among other issues. Additionally, in order to further evaluate the performance of the developed cross-user models, a completely new dataset was created (using the same recording device) that includes known covariate factors such as cross-day use and limb-position variability. The results show that the large data models can effectively generalize to new datasets and mitigate the impact of common confounding factors that have historically limited the adoption of EMG-based inputs.Keywords
All Related Versions
Funding Information
- Natural Sciences and Engineering Research Council of Canada
This publication has 90 references indexed in Scilit:
- CNN-LSTM and post-processing for EMG-based hand gesture recognitionIntelligent Systems with Applications, 2024
- A comparison of EMG-based hand gesture recognition systems based on supervised and reinforcement learningEngineering Applications of Artificial Intelligence, 2023
- Multi-day dataset of forearm and wrist electromyogram for hand gesture recognition and biometricsScientific Data, 2022
- Toward higher-performance bionic limbs for wider clinical useNature Biomedical Engineering, 2021
- Pattern recognition of electromyography signals based on novel time domain features for amputees' limb motion classificationComputers and Electrical Engineering, 2018
- Myoelectric Pattern Recognition Outperforms Direct Control for Transhumeral Amputees with Targeted Muscle Reinnervation: A Randomized Clinical TrialScientific Reports, 2017
- The great time series classification bake off: a review and experimental evaluation of recent algorithmic advancesData Mining and Knowledge Discovery, 2016
- Electromyography data for non-invasive naturally-controlled robotic hand prosthesesScientific Data, 2014
- Feature reduction and selection for EMG signal classificationExpert Systems with Applications, 2012
- Ubiquitous computing: An overview of technology impactsTelematics and Informatics, 2011