Accurate Prediction of Knee Joint Angles Using a Hybrid CNN-LSTM-Attention Network from Surface Electromyography
Authors:
- 10 December 2024
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 2233-2240
Abstract
In various fields such as robotics, rehabilitation, biomechanics, human-machine interfaces, and clinical research, human motion prediction has extensive applications. A hybrid networks model based on Convolutional Neural Network-Long Short-Term Memory-Attention (CNN-LSTM-Attention) was employed in this paper to extract features from the high-dimensional space and time series of surface electromyography (sEMG) data for continuous prediction of knee angles. Five able-bodied subjects participated in the study, walking at a self-selected pace while six surface electromyography (sEMG) signals from muscles involved in knee flexion and extension, along with knee angles, were synchronously recorded. The performance was assessed using the root mean square error (RMSE), Pearson Correlation Coefficient $(r)$, and coefficient of determination $(R^{2})$ between estimated and measured knee joint angles. Compared to the CNN, LSTM, and CNN-LSTM algorithms, the adopted method estimated knee angles more accurately, achieving an average RMSE, $\rho$, and $R^{2}$ of $3.09\pm 0.90,\ 0.9911 \pm 0.0052$, and $0.9817\pm 0.0108$, respectively. As the advance time increased, the accuracy of knee joint angle estimation decreased, particularly when the advance time reached 100 ms, at which point the RMSE is 4.83 degress. In addition, the computing time of the prediction model was less than 1 ms, which was shorter than the advance time 100 ms it could predict, thereby facilitating real-time computation in practical environments. Compared to previous studies, the proposed method excelled at extracting features directly from raw signals, avoiding the need for handcrafted feature extraction. Consequently, the model effectively achieved continuous and accurate predictions of joint motion angles and demonstrated potential to reduce latency in the human-machine interface.
Keywords
Funding Information
- National Key R&D Program of China (2022YFC3601704,2022YFB4703504)
- National Natural Science Foundation of China (62273325,62125307,62303444)
- China Postdoctoral Science Foundation (GZC20232866,2023M743691)
This publication has 31 references indexed in Scilit:
- Terrain Recognition and Gait Cycle Prediction Using IMU2021
- MyoNet: A Transfer-Learning-Based LRCN for Lower Limb Movement Recognition and Knee Joint Angle Prediction for Remote Monitoring of Rehabilitation Progress From sEMGIEEE Journal of Translational Engineering in Health and Medicine, 2020
- Real-Time Intended Knee Joint Motion Prediction by Deep-Recurrent Neural NetworksIEEE Sensors Journal, 2019
- Real-time Decoding of EEG Gait Intention for Controlling a Lower-limb Exoskeleton System2019
- Generalization of ANN Model in Classifying Stance and Swing Phases of Gait using EMG Signals2018
- Surface EMG based continuous estimation of human lower limb joint angles by using deep belief networksBiomedical Signal Processing and Control, 2018
- CEINMS: A toolbox to investigate the influence of different neural control solutions on the prediction of muscle excitation and joint moments during dynamic motor tasksJournal of Biomechanics, 2015
- sEMG-based continuous estimation of joint angles of human legs by using BP neural networkNeurocomputing, 2012
- EMG signals based gait phases recognition using hidden Markov models2010
- Development of recommendations for SEMG sensors and sensor placement proceduresJournal of Electromyography and Kinesiology, 2000