Deep convolutional neural networks for sign language recognition
- 1 January 2018
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 194-197
Abstract
Extraction of complex head and hand movements along with their constantly changing shapes for recognition of sign language is considered a difficult problem in computer vision. This paper proposes the recognition of Indian sign language gestures using a powerful artificial intelligence tool, convolutional neural networks (CNN). Selfie mode continuous sign language video is the capture method used in this work, where a hearing-impaired person can operate the SLR mobile application independently. Due to non-availability of datasets on mobile selfie sign language, we initiated to create the dataset with five different subjects performing 200 signs in 5 different viewing angles under various background environments. Each sign occupied for 60 frames or images in a video. CNN training is performed with 3 different sample sizes, each consisting of multiple sets of subjects and viewing angles. The remaining 2 samples are used for testing the trained CNN. Different CNN architectures were designed and tested with our selfie sign language data to obtain better accuracy in recognition. We achieved 92.88% recognition rate compared to other classifier models reported on the same dataset.Keywords
This publication has 7 references indexed in Scilit:
- NEURAL NETWORK CLASSIFIER FOR CONTINUOUS SIGN LANGUAGE RECOGNITION WITH SELFIE VIDEOFar East Journal of Electronics and Communications, 2017
- Indian Classical Dance Classification with Adaboost Multiclass Classifier on Multifeature FusionMathematical Problems in Engineering, 2017
- Real-time Sign Language Recognition with Guided Deep Convolutional Neural Networks2016
- Sign Language Recognition System Simulated for Video Captured with Smart Phone Front CameraInternational Journal of Electrical and Computer Engineering (IJECE), 2016
- Sign Language Interpretation Using Pseudo Glove2016
- Learning Deep Architectures for AIFoundations and Trends in Machine Learning, 2009
- Sign Language Recognition and Translation: A Multidisciplined Approach From the Field of Artificial IntelligenceJournal of Deaf Studies and Deaf Education, 2005