Improvement of robot audition by interfacing sound source separation and automatic speech recognition with Missing Feature Theory
Authors:
- K. NakadaiKNK. Nakadai
- H. TsujinoHTH. Tsujino
- T. YokoyamaTYT. Yokoyama
- H.G. OkunoHOH.G. Okuno
- 1 January 2004
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- Vol. 2 (10504729) , 1517-1523 Vol.2
Abstract
We have been developed robot audition system using the active direction-pass filter (ADPF) with the Scattering Theory, and demonstrated that the humanoid SIG could separate and recognize three simultaneous speeches originating from different directions. This is the first result that a robot can listen to several things simultaneously. However, its general applicability to other robots is not yet confirmed. Since automatic speech recognition (ASR) requires direction- and speaker-dependent acoustic models, it is difficult to adapt various kinds of environments. In addition ASR with lots of acoustic models causes slow processing. In this paper, these three problems are resolved. First, we confirmed the generality of the ADPF by applying it to two humanoids, SIG2 and Replie, under different environments. Next, we present the new interface between ADPF and ASR based on the Missing Feature Theory, which masks broken features of separated sound to make them unavailable to ASR. This new interface improved the recognition performance of three simultaneous speeches up to about 90%. Finally, since the ASR uses only a single acoustic model that is direction- and speaker-independent and created under clean environments, the processing of the whole system was made very light and fast.Keywords
This publication has 12 references indexed in Scilit:
- Developing the ETSI Aurora advanced distributed speech recognition front-end and what next?2005
- Autonomous behavior control architecture of entertainment humanoid robot SDR-4X2004
- Applying scattering theory to robot audition system: robust sound source localization and extraction2004
- Robot recognizes three simultaneous speech by active audition2004
- Real-time speaker localization and speech separation by audio-visual integration2003
- Emotive qualities in robot speech2002
- Active audition system and humanoid exterior design2002
- Robust face detection against brightness fluctuation and size variation2002
- Missing data speech recognition in reverberant conditions2002
- Convergence analysis of online linear discriminant analysis2000