Neural network based spectral mask estimation for acoustic beamforming
Top Cited Papers
- 1 March 2016
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 196-200
Abstract
We present a neural network based approach to acoustic beamforming. The network is used to estimate spectral masks from which the Cross-Power Spectral Density matrices of speech and noise are estimated, which in turn are used to compute the beamformer coefficients. The network training is independent of the number and the geometric configuration of the microphones. We further show that it is possible to train the network on clean speech only, avoiding the need for stereo data with separated speech and noise. Two types of networks are evaluated. One small feed-forward network with only one hidden layer and one more elaborated bi-directional Long Short-Term Memory network. We compare our system with different parametric approaches to mask estimation and using different beamforming algorithms. We show that our system yields superior results, both in terms of perceptual speech quality and with respect to speech recognition error rate. The results for the simple feed-forward network are especially encouraging considering its low computational requirements.Keywords
This publication has 14 references indexed in Scilit:
- BLSTM supported GEV beamformer front-end for the 3RD CHiME challenge2015
- The third ‘CHiME’ speech separation and recognition challenge: Dataset, task and baselines2015
- Speech acoustic modeling from raw multichannel waveforms2015
- Relaxed disjointness based clustering for joint blind source separation and dereverberation2014
- Convolutional Neural Networks for Distant Speech RecognitionIEEE Signal Processing Letters, 2014
- Underdetermined Convolutive Blind Source Separation via Frequency Bin-Wise Clustering and Permutation AlignmentIEEE Transactions on Audio, Speech, and Language Processing, 2010
- Blind Acoustic Beamforming Based on Generalized Eigenvalue DecompositionIEEE Transactions on Audio, Speech, and Language Processing, 2007
- Post-Filtering Techniques2001
- Backpropagation through time: what it does and how to do itProceedings of the IEEE, 1990
- The generalized correlation method for estimation of time delayIEEE Transactions on Acoustics, Speech, and Signal Processing, 1976