Deep learning approach for sign language's handshapes recognition from EMG signals
- 15 July 2022
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 1-5
Abstract
Electromyographic (EMG) signals are beginning to be increasingly used as alternatives for gesture recognition. Indeed, EMG signals are used to control machines (drones, robots, VR, PowerPoint presentation…). In the field of assistive technologies, EMG signals offer new solutions for people with disabilities. Namely, the control of prostheses for disabled people or the control of wheelchairs or computers for paralyzed people. Through this work we aim to use electromyographic signals for the recognition of sign languages alphabets. The signals are received by 8 sensors mounted on an armband that the deaf person can wear on the forearm. We propose a new approach for the classification of EMG signals using an approach based on new deep learning solutions. We used a sequence of CNN layers followed by two LSTM layers to extract features from Electromyographic data. We implemented and evaluated the proposed approach using 28 handshapes representing Arabic alphabets. We obtained an average accuracy of 98,49%.Keywords
This publication has 15 references indexed in Scilit:
- EMG-based hand gesture classification by scale average wavelet transform and CNN2019
- A Quantitative Performance Assessment of surface EMG and Accelerometer in Sign Language Recognition2019
- Finger language recognition based on ensemble artificial neural network learning using armband EMG sensorsTechnology and Health Care, 2018
- Signer-independent classification of American sign language word signs using surface EMG2017
- Public speaking words (Indian sign language) recognition using EMG2017
- Evaluating Sign Language Recognition Using the Myo Armband2016
- Real-Time American Sign Language Recognition System Using Surface EMG Signal2015
- Sign language-Thai alphabet conversion based on Electromyogram (EMG)2014
- Bi-channel sensor fusion for automatic sign language recognition2008
- EMG-based hand gesture recognition for realtime biosignal interfacing2008