Recognition of Japanese finger spelling gestures using neural networks
- 9 February 2010
- journal article
- other
- Published by Taylor & Francis in Journal of Medical Engineering & Technology
- Vol. 34 (4) , 254-260
Abstract
Effective communication with the hearing and speech impaired often requires at least a basic working knowledge of sign language gestures, without which a memo pad and pen, or a mobile phone's notepad is indispensable. The aim of this study was to build a neural network that could be used to recognize static finger-hand gestures of the yubimoji, the Japanese sign language syllabary. To build the network, signal inputs from a data glove interface were taken for each of the static yubimoji gestures. The network was trained and tested 10 times using a multilayer perceptron model. Overall, only 18 of the 41 static gestures were successfully recognized. One of the reasons was attributed to the inability of the data glove to measure gesture directions particularly for yubimoji gestures with similar finger configurations. Future work will focus on these problems as well as the inclusion of dynamic yubimoji gestures.Keywords
This publication has 6 references indexed in Scilit:
- Neural Networks in ECG Classification2011
- Improving Features Subset Selection Using Genetic Algorithms for Iris Recognition2008
- Evaluation of text telephones designed for people with impaired hearing or speechJournal of Medical Engineering & Technology, 2005
- Neural networks for the prediction and forecasting of water resources variables: a review of modelling issues and applicationsEnvironmental Modelling & Software, 2000
- A survey of glove-based inputIEEE Computer Graphics and Applications, 1994
- Hand gesture coding based on experiments using a hand gesture interface deviceACM SIGCHI Bulletin, 1991