Hand gesture symmetric behavior detection and analysis in natural conversation
Authors:
- Yingen XiongYXYingen Xiong
- F. QuekFQF. Quek
- D. McNeillDMD. McNeill
- 26 June 2003
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 179-184
Abstract
We present an experimental investigation into the phenomenon of gestural symmetry for two-handed gestures accompanying speech. We describe an approach to compute hand motion symmetries based on the correlation computations. Local symmetries are detected using a windowing operation. We demonstrate that the selection of a smaller window size results in better sensitivity to local symmetries at the expense of noise in the form of spurious symmetries and 'symmetry dropoffs'. Our algorithm applies a 'hole filling' post process to address these detection problems. We examine the role of the detected motion symmetries of two-handed gestures in the structuring of speech. We compared discourse segments corresponding to extracted symmetries in two natural conversations against a discourse analysis by expert psycholinguistic coders. These comparisons illustrate the effectiveness of the symmetry feature for the understanding of underlying discourse structure. We believe that this basic characteristic of two-handed gestures accompanying speech must be incorporated in any multimodal interaction system involving two-handed gestures and speech.Keywords
This publication has 8 references indexed in Scilit:
- Computer vision for television and games2005
- Gesture cues for conversational interaction in monocular video2003
- A parallel algorithm for dynamic gesture tracking2003
- Dynamical system representation, generation, and recognition of basic oscillatory motion gestures2002
- Catchments, prosody and discourseGesture, 2001
- Growth points in thinking-for-speaking2000
- Catchments and contexts: non-modular factors in speech and gesture production2000
- Robust real-time periodic motion detection, analysis, and applicationsIEEE Transactions on Pattern Analysis and Machine Intelligence, 2000