Deepfilternet: A Low Complexity Speech Enhancement Framework for Full-Band Audio Based On Deep Filtering
Authors:
Top Cited Papers
- 23 May 2022
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 7407-7411
Abstract
Complex-valued processing has brought deep learning-based speech enhancement and signal extraction to a new level. Typically, the process is based on a time-frequency (TF) mask which is applied to a noisy spectrogram, while complex masks (CM) are usually preferred over real-valued masks due to their ability to modify the phase. Recent work proposed to use a complex filter instead of a point-wise multiplication with a mask. This allows to incorporate information from previous and future time steps exploiting local correlations within each frequency band.In this work, we propose DeepFilterNet, a two stage speech enhancement framework utilizing deep filtering. First, we enhance the spectral envelope using ERB-scaled gains modeling the human frequency perception. The second stage employs deep filtering to enhance the periodic components of speech. Additionally to taking advantage of perceptual properties of speech, we enforce network sparsity via separable convolutions and extensive grouping in linear and recurrent layers to design a low complexity architecture.We further show that our two stage deep filtering approach outperforms complex masks over a variety of frequency resolutions and latencies and demonstrate convincing performance compared to other state-of-the-art models.Keywords
All Related Versions
This publication has 18 references indexed in Scilit:
- Deep Filtering: Signal Extraction and Reconstruction Using Complex Time-Frequency FiltersIEEE Signal Processing Letters, 2019
- Learning Complex Spectral Mapping With Gated Convolutional Recurrent Networks for Monaural Speech EnhancementIEEE/ACM Transactions on Audio, Speech, and Language Processing, 2019
- SDR – Half-baked or Well Done?2019
- Complex Spectral Mapping with a Convolutional Recurrent Network for Monaural Speech Enhancement2019
- Phasebook and Friends: Leveraging Discrete Representations for Source SeparationIEEE Journal of Selected Topics in Signal Processing, 2019
- A Hybrid DSP/Deep Learning Approach to Real-Time Full-Band Speech Enhancement2018
- Looking to listen at the cocktail partyACM Transactions on Graphics, 2018
- Investigating RNN-based speech enhancement methods for noise-robust Text-to-Speech2016
- Complex Ratio Masking for Monaural Speech SeparationIEEE/ACM Transactions on Audio, Speech, and Language Processing, 2015
- Generating sensor signals in isotropic noise fieldsThe Journal of the Acoustical Society of America, 2007