Accurate Prediction of Knee Joint Angles Using a Hybrid CNN-LSTM-Attention Network from Surface Electromyography

Authors:

Abstract
In various fields such as robotics, rehabilitation, biomechanics, human-machine interfaces, and clinical research, human motion prediction has extensive applications. A hybrid networks model based on Convolutional Neural Network-Long Short-Term Memory-Attention (CNN-LSTM-Attention) was employed in this paper to extract features from the high-dimensional space and time series of surface electromyography (sEMG) data for continuous prediction of knee angles. Five able-bodied subjects participated in the study, walking at a self-selected pace while six surface electromyography (sEMG) signals from muscles involved in knee flexion and extension, along with knee angles, were synchronously recorded. The performance was assessed using the root mean square error (RMSE), Pearson Correlation Coefficient $(r)$, and coefficient of determination $(R^{2})$ between estimated and measured knee joint angles. Compared to the CNN, LSTM, and CNN-LSTM algorithms, the adopted method estimated knee angles more accurately, achieving an average RMSE, $\rho$, and $R^{2}$ of $3.09\pm 0.90,\ 0.9911 \pm 0.0052$, and $0.9817\pm 0.0108$, respectively. As the advance time increased, the accuracy of knee joint angle estimation decreased, particularly when the advance time reached 100 ms, at which point the RMSE is 4.83 degress. In addition, the computing time of the prediction model was less than 1 ms, which was shorter than the advance time 100 ms it could predict, thereby facilitating real-time computation in practical environments. Compared to previous studies, the proposed method excelled at extracting features directly from raw signals, avoiding the need for handcrafted feature extraction. Consequently, the model effectively achieved continuous and accurate predictions of joint motion angles and demonstrated potential to reduce latency in the human-machine interface.
Funding Information
  • National Key R&D Program of China (2022YFC3601704,2022YFB4703504)
  • National Natural Science Foundation of China (62273325,62125307,62303444)
  • China Postdoctoral Science Foundation (GZC20232866,2023M743691)

This publication has 31 references indexed in Scilit: