Sign Language Fingerspelling Recognition Using Depth Information and Deep Belief Networks
Authors:
- 21 February 2018
- journal article
- research article
- Published by World Scientific Pub Co Pte Ltd in International Journal of Pattern Recognition and Artificial Intelligence
- Vol. 32 (06)
Abstract
In the sign language fingerspelling scheme, letters in the alphabet are presented by a distinctive finger shape or movement. The presented work is conducted for autokinetic translating fingerspelling signs to text. A recognition framework by using intensity and depth information is proposed and compared with some distinguished works. Histogram of Oriented Gradients (HOG) and Zernike moments are used as discriminative features due to their simplicity and good performance. A Deep Belief Network (DBN) composed of three Restricted Boltzmann Machines (RBMs) is used as a classifier. Experiments are executed on a challenging database, which consists of 120,000 pictures representing 24 alphabet letters over five different users. The proposed approach obtained higher average accuracy, outperforming all other methods. This indicates the effectiveness and the abilities of the proposed framework.Keywords
This publication has 6 references indexed in Scilit:
- A survey of deep neural network architectures and their applicationsNeurocomputing, 2017
- RETRACTED ARTICLE: A Survey on Recent Vision-Based Gesture RecognitionIntelligent Industrial Systems, 2016
- Recent methods and databases in vision-based hand gesture recognition: A reviewComputer Vision and Image Understanding, 2015
- A Survey of Applications and Human Motion Recognition with Microsoft KinectInternational Journal of Pattern Recognition and Artificial Intelligence, 2015
- Sign Language Recognition with the Kinect Sensor Based on Conditional Random FieldsSensors, 2014
- Recent developments in visual sign language recognitionUniversal Access in the Information Society, 2007