Feature Mapping of Multiple Beamformed Sources for Robust Overlapping Speech Recognition Using a Microphone Array
- 20 October 2014
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE/ACM Transactions on Audio, Speech, and Language Processing
- Vol. 22 (12) , 2244-2255
Abstract
This paper introduces a nonlinear vector-based feature mapping approach to extract robust features for automatic speech recognition (ASR) of overlapping speech using a microphone array. We explore different configurations and additional sources of information to improve the effectiveness of the feature mapping. First, we investigate the full-vector based mapping of different sources in a log mel-filterbank energy (log MFBE) domain, and demonstrate that retraining the acoustic model using the generated training data can help improve the recognition performance. Then we investigate the feature mapping between different domains. Finally in order to improve the qualities of the mapping inputs we propose a nonlinear mapping of the features from multiple beamformed sources, which are directed at the target and interfering speakers, respectively. We demonstrate the effectiveness of the proposed approach through extensive evaluations on the MONC corpus, which includes non-overlapping single speaker and overlapping multi-speaker conditions.Keywords
This publication has 27 references indexed in Scilit:
- An investigation of deep neural networks for noise robust speech recognition2013
- Adaptive Nonlinear Regression Using Multiple Distributed Microphones for In-Car Speech RecognitionIEICE Transactions on Fundamentals of Electronics, Communications and Computer Sciences, 2005
- Optimal estimators for spectral restoration of noisy speech2005
- Microphone array speech recognition: experiments on overlapping speech in meetings2004
- Independent Component Analysis1998
- Maximum a posteriori estimation for multivariate Gaussian mixture observations of Markov chainsIEEE Transactions on Speech and Audio Processing, 1994
- Microphone arrays and neural networks for robust speech recognition1994
- RASTA processing of speechIEEE Transactions on Speech and Audio Processing, 1994
- An alternative approach to linearly constrained adaptive beamformingIEEE Transactions on Antennas and Propagation, 1982
- Cepstral analysis technique for automatic speaker verificationIEEE Transactions on Acoustics, Speech, and Signal Processing, 1981