Teacher-Student Learning for Low-Latency Online Speech Enhancement Using Wave-U-Net
- 6 June 2021
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 661-665
Abstract
In this paper, we propose a low-latency online extension of wave-U-net for single-channel speech enhancement, which utilizes teacher-student learning to reduce the system latency while keeping the enhancement performance high. Wave-U-net is a recently proposed end-to-end source separation method, which achieved remarkable performance in singing voice separation and speech enhancement tasks. Since the enhancement is performed in the time domain, wave-U-net can efficiently model phase information and address the domain transformation limitation, where the time-frequency domain is normally adopted. In this paper, we apply wave-U-net to face-to-face applications such as hearing aids and in-car communication systems, where a strictly low-latency of less than 10 ms is required. To this end, we investigate online versions of wave-U-net and propose the use of teacher-student learning to prevent the performance degradation caused by the reduction in input segment length such that the system delay in a CPU is less than 10 ms. The experimental results revealed that the proposed model could perform in real-time with low-latency and high performance, achieving a signal-to-distortion ratio improvement of about 8.73 dB.Keywords
This publication has 18 references indexed in Scilit:
- A Convolutional Recurrent Neural Network for Real-Time Speech Enhancement2018
- Supervised Speech Separation Based on Deep Learning: An OverviewIEEE/ACM Transactions on Audio, Speech, and Language Processing, 2018
- TaSNet: Time-Domain Audio Separation Network for Real-Time, Single-Channel Speech Separation2018
- Complex Ratio Masking for Monaural Speech SeparationIEEE/ACM Transactions on Audio, Speech, and Language Processing, 2015
- Speech Enhancement with LSTM Recurrent Neural Networks and its Application to Noise-Robust ASR2015
- Phase-sensitive and recognition-boosted speech separation using deep recurrent neural networks2015
- Speech Enhancement2013
- The effect of phase information in speech enhancement and speech recognition2012
- The importance of phase in speech enhancementSpeech Communication, 2011
- A short-time objective intelligibility measure for time-frequency weighted noisy speech2010