Adversarial Network Bottleneck Features for Noise Robust Speaker Verification
Preprint
Abstract
In this paper, we propose a noise robust bottleneck feature representation which is generated by an adversarial network (AN). The AN includes two cascade connected networks, an encoding network (EN) and a discriminative network (DN). Mel-frequency cepstral coefficients (MFCCs) of clean and noisy speech are used as input to the EN and the output of the EN is used as the noise robust feature. The EN and DN are trained in turn, namely, when training the DN, noise types are selected as the training labels and when training the EN, all labels are set as the same, i.e., the clean speech label, which aims to make the AN features invariant to noise and thus achieve noise robustness. We evaluate the performance of the proposed feature on a Gaussian Mixture Model-Universal Background Model based speaker verification system, and make comparison to MFCC features of speech enhanced by short-time spectral amplitude minimum mean square error (STSA-MMSE) and deep neural network-based speech enhancement (DNN-SE) methods. Experimental results on the RSR2015 database show that the proposed AN bottleneck feature (AN-BN) dramatically outperforms the STSA-MMSE and DNN-SE based MFCCs for different noise types and signal-to-noise ratios. Furthermore, the AN-BN feature is able to improve the speaker verification performance under the clean condition.Keywords
All Related Versions
This publication has 12 references indexed in Scilit:
- Loss-Sensitive Generative Adversarial Networks on Lipschitz DensitiesInternational Journal of Computer Vision, 2019
- Adversarial Learning for Neural Dialogue Generation2017
- Speech Intelligibility Potential of General and Specialized Deep Neural Network Based Speech Enhancement SystemsIEEE/ACM Transactions on Audio, Speech, and Language Processing, 2016
- An Improved Ranking-Based Feature Enhancement Approach for Robust Speaker RecognitionIEEE Access, 2016
- A Regression Approach to Speech Enhancement Based on Deep Neural NetworksIEEE/ACM Transactions on Audio, Speech, and Language Processing, 2014
- On Training Targets for Supervised Speech SeparationIEEE/ACM Transactions on Audio, Speech, and Language Processing, 2014
- Front-End Factor Analysis for Speaker VerificationIEEE Transactions on Audio, Speech, and Language Processing, 2010
- Minimum Mean-Square Error Estimation of Discrete Fourier Coefficients With Generalized Gamma PriorsIEEE Transactions on Audio, Speech, and Language Processing, 2007
- Speaker Verification Using Adapted Gaussian Mixture ModelsDigital Signal Processing, 2000
- Speech enhancement using a minimum-mean square error short-time spectral amplitude estimatorIEEE Transactions on Acoustics, Speech, and Signal Processing, 1984