Binaural Sound Localization Based on Reverberation Weighting and Generalized Parametric Mapping
Authors:
- 11 May 2017
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE/ACM Transactions on Audio, Speech, and Language Processing
- Vol. 25 (8) , 1618-1632
Abstract
Binaural sound source localization is an important technique for speech enhancement, video conferencing, and human-robot interaction, etc. However, in realistic scenarios, the reverberation and environmental noise would degrade the precision of sound direction estimation. Therefore, reliable sound localization is essential to practical applications. To deal with these disturbances, this paper presents a novel binaural sound source localization approach based on reverberation weighting and generalized parametric mapping. First, the reverberation weighting as a preprocessing stage, is used to separately suppress the early and late reverberation, while preserving interaural cues. Then, two binaural cues, i.e., interaural time and intensity differences, are extracted from the frequency-domain representations of dereverberated binaural signals for the online localization. Their corresponding templates are established using the training data. Furthermore, the generalized parametric mapping is proposed to build a generalized parametric model for describing relationships between azimuth and binaural cues analytically. Finally, a two-step sound localization process is introduced to refine azimuth estimation based on the generalized parametric model and template matching. Experiments in both simulated and real scenarios validate that the proposed method can achieve better localization performance compared to state-of-the-art methods.Keywords
Funding Information
- National High Level Talent Special Support Program
- National Natural Science Foundation of China (61340046, 61673030, U1613209)
- Specialized Research Fund for the Doctoral Program of Higher Education (20130001110011)
- Natural Science Foundation of Guangdong Province (2015A030311034)
This publication has 37 references indexed in Scilit:
- Binaural Dereverberation2013
- Microphone array post-filter based on noise field coherenceIEEE Transactions on Speech and Audio Processing, 2003
- Speech segregation based on sound localizationThe Journal of the Acoustical Society of America, 2003
- A new cepstral prefiltering technique for estimating time delay under reverberant conditionsSignal Processing, 1997
- An analog electronic cochleaIEEE Transactions on Acoustics, Speech, and Signal Processing, 1988
- Multiple emitter location and signal parameter estimationIEEE Transactions on Antennas and Propagation, 1986
- Image method for efficiently simulating small-room acousticsThe Journal of the Acoustical Society of America, 1979
- The generalized correlation method for estimation of time delayIEEE Transactions on Acoustics, Speech, and Signal Processing, 1976
- New Method of Measuring Reverberation TimeThe Journal of the Acoustical Society of America, 1965
- A place theory of sound localization.Journal of Comparative and Physiological Psychology, 1948