A scene-associated training method for mobile robot speech recognition in multisource reverberated environments
Authors:
- 1 September 2011
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 542-549
Abstract
In this paper, we present a new technique for social mobile robot speech recognition based on scene-associated training models. The key contribution of the paper is a real-time framework that reduces the effect of room reverberation and ambient noise, a challenging problem in speech recognition. In classical approaches, anechoic sound is used to train the model, with the main focus on removing reverberation or noise from the sound. Our technique differs in that we train a number of speech recognizers directly from the reverberated sound, by associating each recognizer with a unique visual scene, to deal with the varying reverberation properties of different rooms. By extracting local features from a captured image and recognizing a scene, the robot can use the appropriate speech recognizer that is trained for the particular structural properties of that scene. We tested our method by using a baseline speech recognition model (HTK) across a variety of rooms and different levels of background noise. The results show that the association between a visual scene and a corresponding speech recognizer greatly improves the robot's speech recognition accuracy, together with increasing the computational speed of recognition, compared to competing techniques.Keywords
This publication has 17 references indexed in Scilit:
- Global localization in a dense continuous topological map2011
- Perception of Auditory, Visual, and Egocentric Spatial Alignment Adapts Differently to Changes in Eye PositionJournal of Neurophysiology, 2010
- Monaural speech separation and recognition challengeComputer Speech & Language, 2010
- Visual loop closing using multi-resolution SIFT grids in metric-topological SLAM2009
- Visual topological SLAM and global localization2009
- Developments and directions in speech recognition and understanding, Part 1 [DSP Education]IEEE Signal Processing Magazine, 2009
- Rapid Biologically-Inspired Scene Classification Using Features Shared with Visual AttentionIEEE Transactions on Pattern Analysis and Machine Intelligence, 2007
- An audio-visual corpus for speech perception and automatic speech recognitionThe Journal of the Acoustical Society of America, 2006
- A two-stage algorithm for one-microphone reverberant speech enhancementIEEE Transactions on Audio, Speech, and Language Processing, 2006
- SURF: Speeded Up Robust Features2006