Magnitude-and-phase-aware Speech Enhancement with Parallel Sequence Modeling
Authors:
Preprint
Abstract
In speech enhancement (SE), phase estimation is important for perceptual quality, so many methods take clean speech's complex short-time Fourier transform (STFT) spectrum or the complex ideal ratio mask (cIRM) as the learning target. To predict these complex targets, the common solution is to design a complex neural network, or use a real network to separately predict the real and imaginary parts of the target. But in this paper, we propose to use a real network to estimate the magnitude mask and normalized cIRM, which not only avoids the significant increase of the model complexity caused by complex networks, but also shows better performance than previous phase estimation methods. Meanwhile, we devise a parallel sequence modeling (PSM) block to improve the RNN block in the convolutional recurrent network (CRN)-based SE model. We name our method as magnitude-and-phase-aware and PSM-based CRN (MPCRN). The experimental results illustrate that our MPCRN has superior SE performance.Keywords
All Related Versions
This publication has 13 references indexed in Scilit:
- Glance and gaze: A collaborative learning framework for single-channel speech enhancementApplied Acoustics, 2022
- On the Compensation Between Magnitude and Phase in Speech SeparationIEEE Signal Processing Letters, 2021
- DeepMMSE: A Deep Learning Approach to MMSE-Based Noise Power Spectral Density EstimationIEEE/ACM Transactions on Audio, Speech, and Language Processing, 2020
- Learning Complex Spectral Mapping With Gated Convolutional Recurrent Networks for Monaural Speech EnhancementIEEE/ACM Transactions on Audio, Speech, and Language Processing, 2019
- SEGAN: Speech Enhancement Generative Adversarial Network2017
- The diverse environments multi-channel acoustic noise database: A database of multichannel environmental noise recordingsThe Journal of the Acoustical Society of America, 2013
- The importance of phase in speech enhancementSpeech Communication, 2011
- Evaluation of Objective Quality Measures for Speech EnhancementIEEE Transactions on Audio, Speech, and Language Processing, 2007
- Suppression of acoustic noise in speech using spectral subtractionIEEE Transactions on Acoustics, Speech, and Signal Processing, 1979
- Enhancement and bandwidth compression of noisy speechProceedings of the IEEE, 1979