Continuous Prediction of Wrist Joint Kinematics Using Surface Electromyography From the Perspective of Muscle Anatomy and Muscle Synergy Feature Extraction
- 22 October 2024
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Journal of Biomedical and Health Informatics
- Vol. 29 (1) , 43-55
Abstract
Post-stroke upper limb dysfunction severely impacts patients' daily life quality. Utilizing sEMG signals to predict patients' motion intentions enables more effective rehabilitation by precisely adjusting the assistance level of rehabilitation robots. Employing the muscle synergy (MS) features can establish more accurate and robust mappings between sEMG and motion intentions. However, traditional matrix factorization algorithms based on blind source separation still exhibit certain limitations in extracting MS features. This paper proposes four deep learning models to extract MS features from four distinct perspectives: spatiotemporal convolutional kernels, compression and reconstruction of sEMG, graph topological structure, and the anatomy of target muscles. Among these models, the one based on 3DCNN predicts motion intentions from the muscle anatomy perspective for the first time. It reconstructs 1D sEMG samples collected at each time point into 2D sEMG frames based on the anatomical distribution of target muscles and sEMG electrode placement. These 2D frames are then stacked as video segments and input into 3DCNN for MS feature extraction. Experimental results on both our wrist motion dataset and public Ninapro DB2 dataset demonstrate that the proposed 3DCNN model outperforms other models in terms of prediction accuracy, robustness, training efficiency, and MS feature extraction for continuous prediction of wrist flexion/extension angles. Specifically, the average nRMSE and R2 values of 3DCNN on these two datasets are (0.14/0.93) and (0.04/0.95), respectively. Furthermore, compared to existing studies, the 3DCNN outperforms musculoskeletal models based on direct collocation optimization, physics-informed GANs, and CNN-LSTM-based deep Kalman filter models when evaluated on our datasetKeywords
This publication has 40 references indexed in Scilit:
- Adaptive neuro-fuzzy inference system model driven by the non-negative matrix factorization-extracted muscle synergy patterns to estimate lower limb joint movementsComputer Methods and Programs in Biomedicine, 2023
- Muscle synergies for evaluating upper limb in clinical applications: A systematic reviewHeliyon, 2023
- Stretchable array electromyography sensor with graph neural network for static and dynamic gestures recognition systemnpj Flexible Electronics, 2023
- Commercial device-based hand rehabilitation systems for stroke patients: State of the art and future prospectsHeliyon, 2023
- STCN-GR: Spatial-Temporal Convolutional Networks for Surface-Electromyography-Based Gesture Recognition2021
- A deep Kalman filter network for hand kinematics estimation using sEMGPattern Recognition Letters, 2021
- A large calibrated database of hand movements and grasps kinematicsScientific Data, 2020
- A review on EMG-based motor intention prediction of continuous human upper limb motion for human-robot collaborationBiomedical Signal Processing and Control, 2019
- Evaluation of matrix factorisation approaches for muscle synergy extractionMedical Engineering & Physics, 2018
- Current Trends in Robot-Assisted Upper-Limb Stroke Rehabilitation: Promoting Patient Engagement in TherapyCurrent Physical Medicine and Rehabilitation Reports, 2014