Appearance-based Arabic Sign Language recognition using Hidden Markov Models
Authors:
- 1 April 2014
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 1-6
Abstract
In this paper, we propose a new method to solve sign language recognition problem using appearance-based features. Particularly, Local Binary Patterns (LBP) are employed to describe the texture and the shape of sign language images. The feature vector resulted from LBP operator is further reduced using Principal Component Analysis (PCA). The appearance-based features are classified using Hidden Markov Models (HMM). The performance of the proposed method is measured using Arabic Sign Language (ArSL) database. The proposed method does not rely on the use of data gloves or other means of input devices, and it allows the deaf signers to perform gestures without imposing any restriction on clothing or image background. Using LBP and PCA features, a recognition rate up to 99.97% was achieved for signer dependent recognition.Keywords
This publication has 15 references indexed in Scilit:
- An Effective Face Detection Algorithm Based on Skin Color Information2012
- Local binary pattern based features for sign language recognitionPattern Recognition and Image Analysis, 2011
- Telescopic Vector Composition and Polar Accumulated Motion Residuals for Feature Extraction in Arabic Sign Language RecognitionEURASIP Journal on Image and Video Processing, 2007
- Recognition of Arabic Sign Language Alphabet Using Polynomial ClassifiersEURASIP Journal on Advances in Signal Processing, 2005
- A Chinese sign language recognition system based on SOFM/SRN/HMMPattern Recognition, 2004
- Automation of the arabic sign language recognition2004
- Multiresolution gray-scale and rotation invariant texture classification with local binary patternsIEEE Transactions on Pattern Analysis and Machine Intelligence, 2002
- Recognition of gestures in Arabic sign language using neuro-fuzzy systemsArtificial Intelligence, 2001
- Real-time American sign language recognition using desk and wearable computer based videoIEEE Transactions on Pattern Analysis and Machine Intelligence, 1998
- A tutorial on hidden Markov models and selected applications in speech recognitionProceedings of the IEEE, 1989