Real-Time Robot Audition System That Recognizes Simultaneous Speech in The Real World
- 1 October 2006
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- No. 21530858,p. 5333-5338
Abstract
This paper presents a robot audition system that recognizes simultaneous speech in the real world by using robot-embedded microphones. We have previously reported missing feature theory (MFT) based integration of sound source separation (SSS) and automatic speech recognition (ASR) for building robust robot audition. We demonstrated that a MFT-based prototype system drastically improved the performance of speech recognition even when three speakers talked to a robot simultaneously. However, the prototype system had three problems; being offline, hand-tuning of system parameters, and failure in voice activity detection (VAD). To attain online processing, we introduced FlowDesigner-based architecture to integrate sound source localization (SSL), SSS and ASR. This architecture brings fast processing and easy implementation because it provides a simple framework of shared-object-based integration. To optimize the parameters, we developed genetic algorithm (GA) based parameter optimization, because it is difficult to build an analytical optimization model for mutually dependent system parameters. To improve VAD, we integrated new VAD based on a power spectrum and location of a sound source into the system, since conventional VAD relying only on power often fails due to low signal-to-noise ratio of simultaneous speech. We, then, constructed a robot audition system for Honda ASIMO. As a result, we showed that the system worked online and fast, and had a better performance in robustness and accuracy through experiments on recognition of simultaneous speech in a noisy and echoic environmentKeywords
This publication has 8 references indexed in Scilit:
- Enhanced Robot Speech Recognition Based on Microphone Array Source Separation and Missing Feature Theory2006
- Missing-feature approaches in speech recognitionIEEE Signal Processing Magazine, 2005
- RT-middleware: distributed component middleware for RT (robot technology)2005
- Robot recognizes three simultaneous speech by active audition2004
- Localization of simultaneous moving sound sources for mobile robot using a frequency- domain steered beamformer approach2004
- Geometric source separation: merging convolutive source separation with geometric beamformingIEEE Transactions on Speech and Audio Processing, 2002
- Microphone array post-filtering for non-stationary noise suppression2002
- Robust automatic speech recognition with missing and unreliable acoustic dataSpeech Communication, 2001