Upper-Limb Electromyogram Classification of Reaching-to-Grasping Tasks Based on Convolutional Neural Networks for Control of a Prosthetic Hand
Authors:
Open Access
- 12 October 2021
- journal article
- research article
- Published by Frontiers Media SA in Frontiers in Neuroscience
- Vol. 15
Abstract
In recent years, myoelectric interfaces using surface electromyogram (EMG) signals have been developed for assisting people with physical disabilities. Especially, in the myoelectric interfaces for robotic hands or arms, decoding the user’s upper-limb movement intentions is cardinal to properly control the prosthesis. However, because previous experiments were implemented with only healthy subjects, the possibility of classifying reaching-to-grasping based on the EMG signals from the residual limb without the below-elbow muscles was not investigated yet. Therefore, we aimed to investigate the possibility of classifying reaching-to-grasping tasks using the EMG from the upper arm and upper body without considering wrist muscles for prosthetic users. In our study, seven healthy subjects, one trans-radial amputee, and one wrist amputee were participated and performed 10 repeatable 12 reaching-to-grasping tasks based on the Southampton Hand Assessment Procedure (SHAP) with 12 different weighted (light and heavy) objects. The acquired EMG was processed using the principal component analysis (PCA) and convolutional neural network (CNN) to decode the tasks. The PCA–CNN method showed that the average accuracies of the healthy subjects were 69.4 ± 11.4%, using only the EMG signals by the upper arm and upper body. The result with the PCA–CNN method showed 8% significantly higher accuracies than the result with the widely used time domain and auto-regressive-support vector machine (TDAR–SVM) method as 61.6 ± 13.7%. However, in the cases of the amputees, the PCA–CNN showed slightly lower performance. In addition, in the aspects of assistant daily living, because grip force is also important when grasping an object after reaching, the possibility of classifying the two light and heavy objects in each reaching-to-grasping task was also investigated. Consequently, the PCA–CNN method showed higher accuracy at 70.1 ± 9.8%. Based on our results, the PCA–CNN method can help to improve the performance of classifying reaching-to-grasping tasks without wrist EMG signals. Our findings and decoding method can be implemented to further develop a practical human–machine interface using EMG signals.Keywords
This publication has 45 references indexed in Scilit:
- EMG feature evaluation for improving myoelectric pattern recognition robustnessExpert Systems with Applications, 2013
- Relation between object properties and EMG during reaching to graspJournal of Electromyography and Kinesiology, 2013
- Technology-assisted training of arm-hand skills in stroke: concepts on reacquisition of motor control and therapist guidelines for rehabilitation technology designJournal of NeuroEngineering and Rehabilitation, 2009
- Patterns of Muscle Activity Underlying Object-Specific Grasp by the Macaque MonkeyJournal of Neurophysiology, 2004
- Kinematic Rules for Upper and Lower Arm Contributions to Grasp OrientationJournal of Neurophysiology, 2003
- A robust, real-time control scheme for multifunction myoelectric controlIEEE Transactions on Biomedical Engineering, 2003
- A human-assisting manipulator teleoperated by EMG signals and arm motionsIEEE Transactions on Robotics and Automation, 2003
- EMG feature evaluation for movement control of upper extremity prosthesesIEEE Transactions on Rehabilitation Engineering, 1995
- Constraints on human arm movement trajectories.Canadian Journal of Psychology / Revue canadienne de psychologie, 1987
- Patterns of Static Prehension in Normal HandsAmerican Journal of Occupational Therapy, 1980