Spatio-temporal feature extraction-based hand gesture recognition for isolated American Sign Language and Arabic numbers
Authors:
- 1 September 2009
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- No. 18455921,p. 254-259
Abstract
This paper proposes a system to recognize isolated American Sign Language and Arabic numbers in real-time from stereo color image sequences using Hidden Markov Models (HMMs). Our system is based on three main stages; preprocessing, feature extraction and classification. In preprocessing stage, color and 3D depth map are used to detect and track the hand. The second stage, 3D combined features of location, orientation and velocity with respected to Cartesian and Polar systems are used. Additionally, k-means clustering is employed for HMMs code-word. In the final stage, the hand gesture path is recognized using Left-Right Banded topology (LRB) in conjunction Viterbi path. Experimental results demonstrate that, our system can successfully recognize isolated hand gestures with 98.33% recognition rate.Keywords
This publication has 10 references indexed in Scilit:
- A Novel Method for 3D Face Detection and NormalizationJournal of Multimedia, 2007
- A Neural Network Approach for Hand Gesture Recognition in Virtual Reality Driving Training System of SPG2006
- Biased nature of Bhattacharyya coefficient in correlation of gray-scale objects2007 5th International Symposium on Image and Signal Processing and Analysis, 2005
- Model Structure Selection and Training Algorithms for an HMM Gesture Recognition System2004
- K-means clustering via principal component analysis2004
- A novel skin color model in YCbCr color space and its application to human face detection2003
- Kernel-based object trackingIEEE Transactions on Pattern Analysis and Machine Intelligence, 2003
- An efficient k-means clustering algorithm: analysis and implementationIEEE Transactions on Pattern Analysis and Machine Intelligence, 2002
- Hand gesture recognition using combined features of location, angle and velocityPattern Recognition, 2001
- A tutorial on hidden Markov models and selected applications in speech recognitionProceedings of the IEEE, 1989