On Loss Functions for Supervised Monaural Time-Domain Speech Enhancement
Preprint
Abstract
Many deep learning-based speech enhancement algorithms are designed to minimize the mean-square error (MSE) in some transform domain between a predicted and a target speech signal. However, optimizing for MSE does not necessarily guarantee high speech quality or intelligibility, which is the ultimate goal of many speech enhancement algorithms. Additionally, only little is known about the impact of the loss function on the emerging class of time-domain deep learning-based speech enhancement systems. We study how popular loss functions influence the performance of deep learning-based speech enhancement systems. First, we demonstrate that perceptually inspired loss functions might be advantageous if the receiver is the human auditory system. Furthermore, we show that the learning rate is a crucial design parameter even for adaptive gradient-based optimizers, which has been generally overlooked in the literature. Also, we found that waveform matching performance metrics must be used with caution as they in certain situations can fail completely. Finally, we show that a loss function based on scale-invariant signal-to-distortion ratio (SI-SDR) achieves good general performance across a range of popular speech enhancement evaluation metrics, which suggests that SI-SDR is a good candidate as a general-purpose loss function for speech enhancement systems.Keywords
All Related Versions
This publication has 36 references indexed in Scilit:
- Real-time Speech Enhancement Using an Efficient Convolutional Recurrent Network for Dual-microphone Mobile Phones in Close-talk Scenarios2019
- Using Recurrences in Time and Frequency within U-net Architecture for Speech Enhancement2019
- Deep Learning Based Phase Reconstruction for Speaker Separation: A Trigonometric Perspective2019
- TCNN: Temporal Convolutional Neural Network for Real-time Speech Enhancement in the Time Domain2019
- Deep Learning–Based Noise Reduction Approach to Improve Speech Intelligibility for Cochlear Implant RecipientsEar & Hearing, 2018
- Monaural Speech Enhancement Using Deep Neural Networks by Maximizing a Short-Time Objective Intelligibility Measure2018
- Training Supervised Speech Separation System to Improve STOI and PESQ Directly2018
- Speech enhancement based on neural networks improves speech intelligibility in noise for cochlear implant usersHearing Research, 2017
- Speech enhancement based on neural networks applied to cochlear implant coding strategies2016
- Perceptual evaluation of speech quality (PESQ)-a new method for speech quality assessment of telephone networks and codecs2002