Binaural Localization of Multiple Sound Sources by Non-Negative Tensor Factorization
- 19 February 2018
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE/ACM Transactions on Audio, Speech, and Language Processing
- Vol. 26 (6) , 1072-1082
Abstract
This paper presents non-negative factorization of audio signals for the binaural localization of multiple sound sources within realistic and unknown sound environments. Non-negative tensor factorization (NTF) provides a sparse representation of multichannel audio signals in time, frequency, and space that can be exploited in computational audio scene analysis and robot audition for the separation and localization of sound sources. In the proposed formulation, each sound source is represented by means of spectral dictionaries, temporal activation, and its distribution within each channel (here, left and right ears). This distribution, being dependent on the frequency, can be interpreted as an explicit estimation of the Head-Related Transfer Function (HRTF) of a binaural head which can then be converted into the estimated sound source position. Moreover, the semisupervised formulation of the non-negative factorization allows us to integrate prior knowledge about some sound sources of interest whose dictionaries can be learned in advance, whereas the remaining sources are considered as background sound, which remains unknown and is estimated on the fly. The proposed NTF-based sound source localization is applied here to binaural sound source localization of multiple speakers within realistic sound environments.Keywords
Funding Information
- French EMERGENCE project
- Sorbonne Universités
This publication has 34 references indexed in Scilit:
- Multi-source TDOA estimation in reverberant audio using angular spectra and clusteringSignal Processing, 2012
- Algorithms for Nonnegative Matrix Factorization with the β-DivergenceNeural Computation, 2011
- First Stereo Audio Source Separation Evaluation Campaign: Data, Algorithms and Results2007
- Self-localizing dynamic microphone arraysIEEE Transactions on Systems, Man and Cybernetics, Part C (Applications and Reviews), 2002
- Least squares formulation of robust non-negative factor analysisChemometrics and Intelligent Laboratory Systems, 1997
- HRTF measurements of a KEMARThe Journal of the Acoustical Society of America, 1995
- Speech database development at MIT: Timit and beyondSpeech Communication, 1990
- The bandwidth effect on monaural and binaural localizationHearing Research, 1986
- The generalized correlation method for estimation of time delayIEEE Transactions on Acoustics, Speech, and Signal Processing, 1976
- The Localization of Actual Sources of SoundThe American Journal of Psychology, 1936