A deep learning based approach for Arabic Sign language alphabet recognition using electromyographic signals
- 8 December 2021
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 01-04
Abstract
Unlike spoken languages, Sign languages are mainly based on gestures. This visual aspect makes their recognition a challenge for researchers. Despite the great advances in language processing, sign language recognition still requires a lot of work to achieve acceptable accuracy. On this work we aim to contribute on the improvement of the Arabic sign language recognition. In fact, we aim to exploit the electromyographic EMG signal produced by our muscles while making a gesture to recognize the gesture. Electromyographic signals are rich in information that can be used to calculate muscle activation. They present a potential technology for gesture recognition and classification. These signals are widely used to manufacture human-computer interaction (HMI) devices to control a prosthesis, a robot, or a computer to perform certain predefined tasks. The main objective of our research is to propose a new approach based on deep learning to recognize the Arabic sign language alphabet. We have proposed a novel convolutional neural network that uses LSTM to process feature dependencies. This model is applied to recognize 7 alphabetic characters of Arabic Sign Language. Compared to existing approaches, our approach shows a high accuracy of 97.5%.Keywords
This publication has 23 references indexed in Scilit:
- Self-Recalibrating Surface EMG Pattern Recognition for Neuroprosthesis Control Based on Convolutional Neural NetworkFrontiers in Neuroscience, 2017
- American Sign Language Recognition system by using surface EMG signal2017
- Deep Learning with Convolutional Neural Networks Applied to Electromyography Data: A Resource for the Classification of Movements for Prosthetic HandsFrontiers in Neurorobotics, 2016
- A Wearable System for Recognizing American Sign Language in Real-Time Using IMU and Surface EMG SensorsIEEE Journal of Biomedical and Health Informatics, 2016
- Movement intention decoding based on deep learning for multiuser myoelectric interfaces2016
- Real-Time American Sign Language Recognition System Using Surface EMG Signal2015
- Characterizing EMG data using machine-learning toolsComputers in Biology and Medicine, 2014
- Electromyogram pattern recognition for control of powered upper-limb prostheses: State of the art and challenges for clinical useJournal of Rehabilitation Research and Development, 2011
- Enabling always-available input with muscle-computer interfaces2009
- Sign language structure: An outline of the visual communication systems of the American deaf. By William C. StokoeJr. (Studies in linguistics: Occasional papers, No. 8) Pp. 78. Buffalo, N. Y.: Department of Anthropology and Linguistics, University of Buffalo, 1960.Language, 1961