TSTNN: Two-Stage Transformer Based Neural Network for Speech Enhancement in the Time Domain
Authors:
Top Cited Papers
- 6 June 2021
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 7098-7102
Abstract
In this paper, we propose a transformer-based architecture, called two-stage transformer neural network (TSTNN) for end-to-end speech denoising in the time domain. The proposed model is composed of an encoder, a two-stage transformer module (TSTM), a masking module and a decoder. The encoder maps input noisy speech into feature representation. The TSTM exploits four stacked two-stage transformer blocks to efficiently extract local and global information from the encoder output stage by stage. The masking module creates a mask which will be multiplied with the encoder output. Finally, the decoder uses the masked encoder feature to reconstruct the enhanced speech. Experimental results on the benchmark dataset show that the TSTNN outperforms most state-of-the-art models in time or frequency domain while having significantly lower model complexity.Keywords
This publication has 19 references indexed in Scilit:
- A Wavenet for Speech Denoising2018
- Complex spectrogram enhancement by convolutional neural network with multi-metrics learning2017
- Investigating RNN-based speech enhancement methods for noise-robust Text-to-Speech2016
- Real-Time Single Image and Video Super-Resolution Using an Efficient Sub-Pixel Convolutional Neural Network2016
- Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classification2015
- The voice bank corpus: Design, collection and data analysis of a large regional accent speech database2013
- The diverse environments multi-channel acoustic noise database: A database of multichannel environmental noise recordingsThe Journal of the Acoustical Society of America, 2013
- Speech Enhancement2013
- An Algorithm for Intelligibility Prediction of Time–Frequency Weighted Noisy SpeechIEEE Transactions on Audio, Speech, and Language Processing, 2011
- Evaluation of Objective Quality Measures for Speech EnhancementIEEE Transactions on Audio, Speech, and Language Processing, 2007