Simultaneous Localization and Recognition of Dynamic Hand Gestures
Authors:
- 1 January 2005
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- Vol. 2, 254-260
Abstract
A method for the simultaneous localization and recognition of dynamic hand gestures is proposed. At the core of this method is a dynamic space-time warping (DSTW) algorithm, that aligns a pair of query and model gestures in both space and time. For every frame of the query sequence, feature detectors generate multiple hand region candidates. Dynamic programming is then used to compute both a global matching cost, which is used to recognize the query gesture, and a warping path, which aligns the query and model sequences in time, and also finds the best hand candidate region in every query frame. The proposed framework includes translation invariant recognition of gestures, a desirable property for many HCI systems. The performance of the approach is evaluated on a dataset of hand signed digits gestured by people wearing short sleeve shirts, in front of a background containing other non-hand skin-colored objects. The algorithm simultaneously localizes the gesturing hand and recognizes the hand-signed digit. Although DSTW is illustrated in a gesture recognition setting, the proposed algorithm is a general method for matching time series, that allows for multiple candidate feature vectors to be extracted at each time step.Keywords
This publication has 17 references indexed in Scilit:
- Hand gesture recognition using a real-time tracking method and hidden Markov modelsImage and Vision Computing, 2003
- Active hand tracking2002
- Real-time American Sign Language recognition from video using hidden Markov models2002
- Dynamic time warping for off-line recognition of a small gesture vocabulary2002
- Exact Indexing of Dynamic Time Warping2002
- Probabilistic data association methods for tracking complex visual objectsIEEE Transactions on Pattern Analysis and Machine Intelligence, 2001
- Neural network-based face detectionIEEE Transactions on Pattern Analysis and Machine Intelligence, 1998
- Robotic gesture recognitionLecture Notes in Computer Science, 1998
- Visual interpretation of hand gestures for human-computer interaction: a reviewIEEE Transactions on Pattern Analysis and Machine Intelligence, 1997
- Dynamic programming algorithm optimization for spoken word recognitionIEEE Transactions on Acoustics, Speech, and Signal Processing, 1978