Real-Time Tracking of Multiple Sound Sources by Integration of In-Room and Robot-Embedded Microphone Arrays
- 1 October 2006
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- No. 21530858,p. 852-859
Abstract
Real-time and robust sound source tracking is an important function for a robot operating in a daily environment, because the robot should recognize where a sound event such as speech, music and other environmental sounds originate from. This paper addresses real-time sound source tracking by real-time integration of an in-room microphone array (IRMA) and a robot-embedded microphone array (REMA). The IRMA system consists of 64 ch microphones attached to the walls. It localizes multiple sound sources based on weighted delay-and-sum beam-forming on a 2D plane. The REMA system localizes multiple sound sources in azimuth using eight microphones attached to a robot's head on a rotational table. The localization results are integrated to track multiple sound sources by using a particle filter in real-time. The experimental results show that particle filter based integration improved accuracy and robustness in multiple sound source tracking even when the robot's head was in rotationKeywords
This publication has 13 references indexed in Scilit:
- Sound source tracking with directivity pattern estimation using a 64 ch microphone array2005
- Minimum sidelobe beamforming based on Mini-Max criterionAcoustical Science and Technology, 2004
- Improvement of robot audition by interfacing sound source separation and automatic speech recognition with Missing Feature Theory2004
- Particle filtering algorithms for tracking an acoustic source in a reverberant environmentIEEE Transactions on Speech and Audio Processing, 2003
- Implicit estimation of sound-arrival timeNature, 2003
- Nonlinear filtering for speaker tracking in noisy and reverberant environments2002
- A tutorial on particle filters for online nonlinear/non-Gaussian Bayesian trackingIEEE Transactions on Signal Processing, 2002
- Robust sound localization using multi-source audiovisual information fusionInformation Fusion, 2001
- A Probabilistic Exclusion Principle for Tracking Multiple ObjectsInternational Journal of Computer Vision, 2000
- Hearing lips and seeing voicesNature, 1976