Multi-Channel to Multi-Channel Noise Reduction and Reverberant Speech Preservation in Time-Varying Acoustic Scenes for Binaural Reproduction
Open Access
- 19 June 2024
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE/ACM Transactions on Audio, Speech, and Language Processing
- Vol. 32 (23299290) , 3283-3295
Abstract
Real-life acoustic scenes may be recorded with microphone arrays for spatial audio applications, especially for the purpose of reproducing binaural signals for headphone listening. However, the presence of noise and interference may necessitate preprocessing to enhance the desired signal and improve the listener experience. Various methods have been developed to reduce noise while preserving the desired signal component with minimal distortion. The additional challenges posed by time-varying acoustic scenes are commonly addressed by segmenting the recorded signals into short time frames. Then, the short-time Fourier transform (STFT) is employed with multichannel Wiener filter (MWF) and assuming the multiplicative transfer function(MTF) approximation.This approximation may not apply in the presence of long reverberation times and/or short STFT frames, so alternative techniques are required. This paper explores MWF-based enhancement in time-varying acoustic scenes where the MTF approximation is inapplicable, both analytically and experimentally with normal-hearing listeners. The investigated scene comprises a single desired source in a reverberant environment, and the impact of frame length and acoustic parameters on the rank of the spatial covariance matrix is studied. It is revealed that superior results in terms of reduced distortion and improved listener experience are achieved when using a full-rank spatial covariance matrix.Keywords
Funding Information
- Reality Labs Research @ Meta
This publication has 47 references indexed in Scilit:
- GSC-Based Binaural Speaker Separation Preserving Spatial Cues2018
- A Study into the Design of Steerable Microphone Arrays2017
- Extensions of the binaural MWF with interference reduction preserving the binaural cues of the interfering source2016
- Binaural multichannel Wiener filter with directional interference rejection2015
- Fundamentals of Spherical Array Processing2015
- Sample covariance matrix eigenvalues based blind SNR estimation2014
- Spherical array beamforming for binaural sound reproduction2012
- Multichannel harmonic and percussive component separation by joint modeling of spatial and spectral continuity2011
- Using 3D sound as a navigational aid in virtual environmentsBehaviour & Information Technology, 2004
- Perceptual evaluation of speech quality (PESQ)-a new method for speech quality assessment of telephone networks and codecs2002