VISUAL SPEECH RECOGNITION USING DYNAMIC FEATURES AND SUPPORT VECTOR MACHINES
- 1 July 2008
- journal article
- research article
- Published by World Scientific Pub Co Pte Ltd in International Journal of Image and Graphics
- Vol. 08 (03) , 419-437
Abstract
This paper presents a vision based technique to identify the unspoken phones using a small camera that is located on the headset of the speaker. The system is based on temporal integration of the video data to generate motion history image (MHI). The paper proposes the use of global features to classify the MHI and compares the use of image moments with Discrete Cosine Transform (DCT). A comparison between Zernike moments (ZM) with DCT indicates that while the accuracy of classification for both techniques is very comparable (96% for ZM and 94% for DCT) when there is no relative motion between the camera and the mouth, ZM is resilient to rotation of the camera and continues to gives good results despite rotation but DCT is sensitive to rotation. Based on the accuracy of the system and its resilience to movement artefacts such as rotation, the authors propose the use of such a system for human computer interface. Such a system could be invaluable when it is important to communicate without making a sound, such as giving passwords when in an open office or in public spaces.Keywords
This publication has 9 references indexed in Scilit:
- Analysis of Lip Geometric Features for Audio-Visual Speech RecognitionIEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans, 2004
- Review of shape representation and description techniquesPattern Recognition, 2004
- The recognition of human movement using temporal templatesIEEE Transactions on Pattern Analysis and Machine Intelligence, 2001
- Audiovisual speech processingIEEE Signal Processing Magazine, 2001
- Moment Functions in Image Analysis — Theory and Applications1998
- A tutorial on hidden Markov models and selected applications in speech recognitionProceedings of the IEEE, 1989
- On image analysis by the methods of momentsIEEE Transactions on Pattern Analysis and Machine Intelligence, 1988
- Image analysis via the general theory of moments*Journal of the Optical Society of America, 1980
- Hearing lips and seeing voicesNature, 1976