Reverberant sound localization with a robot head based on direct-path relative transfer function
Authors:
- 1 December 2016
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 2819-2826
Abstract
This paper addresses the problem of sound-source localization (SSL) with a robot head, which remains a challenge in real-world environments. In particular we are interested in locating speech sources, as they are of high interest for human-robot interaction. The microphone-pair response corresponding to the direct-path sound propagation is a function of the source direction. In practice, this response is contaminated by noise and reverberations. The direct-path relative transfer function (DP-RTF) is defined as the ratio between the direct-path acoustic transfer function (ATF) of the two microphones, and it is an important feature for SSL. We propose a method to estimate the DP-RTF from noisy and reverberant signals in the short-time Fourier transform (STFT) domain. First, the convolutive transfer function (CTF) approximation is adopted to accurately represent the impulse response of the microphone array, and the first coefficient of the CTF is mainly composed of the direct-path ATF. At each frequency, the frame-wise speech auto- and cross-power spectral density (PSD) are obtained by spectral subtraction. Then a set of linear equations is constructed by the speech auto- and cross-PSD of multiple frames, in which the DP-RTF is an unknown variable, and is estimated by solving the equations. Finally, the estimated DP-RTFs are concatenated across frequencies and used as a feature vector for SSL. Experiments with a robot, placed in various reverberant environments, show that the proposed method outperforms two state-of-the-art methods.Keywords
All Related Versions
This publication has 31 references indexed in Scilit:
- A Distributed Architecture for Interacting with NAO2015
- Local relative transfer function for sound source localization2015
- Estimation of relative transfer function in the presence of stationary noise based on segmental power spectral density matrix subtraction2015
- Acoustic Space Learning for Sound-Source Separation and Localization on Binaural ManifoldsInternational Journal of Neural Systems, 2015
- Binaural Source Localization by Joint Estimation of ILD and ITDIEEE Transactions on Audio, Speech, and Language Processing, 2009
- On Multiplicative Transfer Function Approximation in the Short-Time Fourier Transform DomainIEEE Signal Processing Letters, 2007
- A Real-Time SRP-PHAT Source Location Implementation using Stochastic Region Contraction(SRC) on a Large-Aperture Microphone Array2007
- Relative Transfer Function Identification Using Speech SignalsIEEE Transactions on Speech and Audio Processing, 2004
- Signal enhancement using beamforming and nonstationarity with applications to speechIEEE Transactions on Signal Processing, 2001
- Robust Localization in Reverberant Rooms2001