A CNN-LSTM Hybrid Model for Wrist Kinematics Estimation Using Surface Electromyography
- 9 November 2020
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Instrumentation and Measurement
- Vol. 70 (00189456) , 1-9
Abstract
Convolutional neural network (CNN) has been widely exploited for simultaneous and proportional myoelectric control due to its capability of deriving informative, representative and transferable features from surface electromyography (sEMG). However, muscle contractions have strong temporal dependencies but conventional CNN can only exploit spatial correlations. Considering that long short-term memory neural network (LSTM) is able to capture long-term and non-linear dynamics of time-series data, in this paper we propose a CNN-LSTM hybrid model to fully explore the temporal-spatial information in sEMG. Firstly, CNN is utilized to extract deep features from sEMG spectrum, then these features are processed via LSTM-based sequence regression to estimate wrist kinematics. Six healthy participants are recruited for the participatory collection and motion analysis under various experimental setups. Estimation results in both intra-session and inter-session evaluations illustrate that CNN-LSTM significantly outperforms CNN, LSTM and several representative machine learning approaches, particularly when complex wrist movements are activated.Keywords
All Related Versions
Funding Information
- Engineering and Physical Sciences Research Council (EP/S019219/1)
- School of Electronic and Electrical Engineering, University of Leeds
- National Natural Science Foundation of China (61962019, 61702395)
This publication has 47 references indexed in Scilit:
- Probability Density Functions of Stationary Surface EMG Signals in Noisy EnvironmentsIEEE Transactions on Instrumentation and Measurement, 2016
- Modeling Spatial-Temporal Clues in a Hybrid Deep Learning Framework for Video Classification2015
- A Novel Algorithm for EMG Signal Processing and Muscle Timing MeasurementIEEE Transactions on Instrumentation and Measurement, 2015
- Long-term recurrent convolutional networks for visual recognition and description2015
- Real-time, simultaneous myoelectric control using visual target-based training paradigmBiomedical Signal Processing and Control, 2014
- Linear and Nonlinear Regression Techniques for Simultaneous and Proportional Myoelectric ControlIEEE Transactions on Neural Systems and Rehabilitation Engineering, 2014
- EMG feature evaluation for improving myoelectric pattern recognition robustnessExpert Systems with Applications, 2013
- Estimation of IMU and MARG orientation using a gradient descent algorithm2011
- Control of Fast-Reaching Movements by Muscle Synergy CombinationsThe Journal of Neuroscience, 2006
- Firing rate modulation of human motor units in different muscles during isometric contraction with various forcesBrain Research, 1996