Speech Dereverberation With Context-Aware Recurrent Neural Networks
- 2 April 2018
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE/ACM Transactions on Audio, Speech, and Language Processing
- Vol. 26 (7) , 1236-1246
Abstract
In this paper, we propose a model to perform speech dereverberation by estimating its spectral magnitude from the reverberant counterpart. Our models are capable of extracting features that take into account both short- and long-term dependencies in the signal through a convolutional encoder (which extracts features from a short, bounded context of frames) and a recurrent neural network for extracting long-term information. Our model outperforms a recently proposed model that uses different context information depending on the reverberation time, without requiring any sort of additional input, yielding improvements of up to 0.4 on perceptual evaluation of speech quality, 0.3 on short-time objective intelligibility, and 1.0 on perceptual objective listening quality assessment relative to reverberant speech. We also show our model is able to generalize to real room impulse responses even when only trained with simulated room impulse responses, different speakers, and high reverberation times. Finally, listening tests show the proposed method outperforming benchmark models in reduction of perceived reverberation.Keywords
All Related Versions
Funding Information
- Natural Sciences and Engineering Research Council of Canada
- Fonds Québécois de la Recherche sur la Nature et les Technologies
This publication has 28 references indexed in Scilit:
- Combination of MVDR beamforming and single-channel spectral processing for enhancing noisy and reverberant speechEURASIP Journal on Advances in Signal Processing, 2015
- Reverberant speech recognition combining deep neural networks and deep autoencoders augmented with a phone-class featureEURASIP Journal on Advances in Signal Processing, 2015
- Learning Spectral Mapping for Speech Dereverberation and DenoisingIEEE/ACM Transactions on Audio, Speech, and Language Processing, 2015
- Discriminatively trained recurrent neural networks for single-channel speech separation2014
- A Regression Approach to Speech Enhancement Based on Deep Neural NetworksIEEE/ACM Transactions on Audio, Speech, and Language Processing, 2014
- On Training Targets for Supervised Speech SeparationIEEE/ACM Transactions on Audio, Speech, and Language Processing, 2014
- On the Properties of Neural Machine Translation: Encoder–Decoder Approaches2014
- Combined Effects of Noise and Reverberation on Speech Recognition Performance of Normal-Hearing Children and AdultsEar & Hearing, 2010
- A spectral subtraction algorithm for suppression of acoustic noise in speech2005
- Signal estimation from modified short-time Fourier transformIEEE Transactions on Acoustics, Speech, and Signal Processing, 1984