Real-Time Translation of Indian Sign Language using LSTM
Authors:
- 1 October 2019
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 1-5
Abstract
Sign language is the only medium of communication for the speech-impaired community while the rest of the population communicate verbally. This project aims to bridge this communication gap by proposing a novel approach to interpret the static and dynamic signs in the Indian Sign Language and convert them to speech. A sensor glove, with flex sensors to detect the bending of each finger and an IMU to read the orientation of the hand, is used to collect data about the actions. This data is then wirelessly transmitted and classified into corresponding speech outputs. LSTM networks were studied and implemented for classification of gesture data because of their ability to learn long-term dependencies. The designed model could classify 26 gestures with an accuracy of 98%, showing the feasibility of using LSTM based neural networks for the purpose of sign language translation.Keywords
This publication has 9 references indexed in Scilit:
- Talking hands — An Indian sign language to speech translating gloves2017
- In-vehicle Hand Gesture Recognition using Hidden Markov models2016
- Smart gloves for hand gesture recognition: Sign language to speech conversion system2016
- Hand gesture recognition system using image processing2016
- Glove-based hand gesture recognition sign language translator using capacitive touch sensor2016
- Double handed Indian Sign Language to speech and text2015
- Indian Sign Language Recognition Using Eigen Value Weighted Euclidean Distance Based Classification TechniqueInternational Journal of Advanced Computer Science and Applications, 2013
- Long Short-Term MemoryNeural Computation, 1997
- Learning long-term dependencies with gradient descent is difficultIEEE Transactions on Neural Networks, 1994