Bridging Communication Gap Among People with Hearing Impairment: An Application of Image Processing and Artificial Neural Network
Authors:
Open Access
- 19 January 2018
- journal article
- Published by Science Publishing Group in International Journal of Information and Communication Sciences
- Vol. 3 (1) , 11-18
Abstract
Before the present study, no sign language recognition system for the Nigeria indigenous sign language particularly Yoruba language has been developed. As a result, this research endeavors at introducing a Yoruba Sign Language recognition system using image processing and Artificial Neural Network (ANN).The proposed system (YSLRS) was implemented and tested. 600 images from 60 different signers were gathered. The images were acquired using vision based method, the different signers were asked to stand in front of a laptop’s camera make sign number from one to ten with their fingers in three different times and the images were stored in a folder. The image dataset was pre-processed for proper presentation for de-noising, segmentation and feature extraction. Thereafter, pattern recognition was done using feed forward back propagation ANN. The study revealed that Median filter with higher PSNR of 47.7 a lower MSE of 1.11, performed better than the Gaussian filter. Furthermore, the efficiency of the developed system was determined using mean square error and the best validation performance occurred at 25 epochs with a MSE of 0.004052, implying than ANN was able to adequately recognize the pattern of the Yoruba signs. Histogram was also used to determine the efficiency of the system, it can be seen that the histogram of the trained, tested and validated error bars were close to zero error, implying that the ANN and Receiver Operating Characteristic (ROC) was used to evaluate the performance of ANN in matching the features of the Yoruba Signs, which shows that ANN performed efficiently, having a high true positive rate and a minimum false positive rate. Finally, YSLRS developed in the study would reduce negative attitudes of victimizations suffered by the hearing-impaired individuals, by bridging communication gap among Nigerian PWD with hearing impairment.Keywords
This publication has 7 references indexed in Scilit:
- Albanian Sign Language (AlbSL) Number Recognition from Both Hand’s Gestures Acquired by Kinect SensorsInternational Journal of Advanced Computer Science and Applications, 2016
- Recognition of Tamil Sign Language Alphabet using Image Processing to aid Deaf-Dumb PeopleProcedia Engineering, 2012
- Vision-based system for continuous Arabic Sign Language recognition in user dependent mode2008
- Recognition of Arabic Sign Language Alphabet Using Polynomial ClassifiersEURASIP Journal on Advances in Signal Processing, 2005
- GIUH based Clark and Nash models for runoff estimation for an ungauged basin and their uncertainty analysisInternational Journal of River Basin Management, 2004
- A Real-Time Large Vocabulary Continuous Recognition System for Chinese Sign Language2001
- A dynamic gesture recognition system for the Korean sign language (KSL)IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics), 1996