Far-Field Automatic Speech Recognition
- 9 September 2020
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in Proceedings of the IEEE
- Vol. 109 (2) , 124-148
Abstract
The machine recognition of speech spoken at a distance from the microphones, known as far-field automatic speech recognition (ASR), has received a significant increase in attention in science and industry, which caused or was caused by an equally significant improvement in recognition accuracy. Meanwhile, it has entered the consumer market with digital home assistants with a spoken language interface being its most prominent application. Speech recorded at a distance is affected by various acoustic distortions, and consequently, quite different processing pipelines have emerged compared with ASR for close-talk speech. A signal enhancement front end for dereverberation, source separation, and acoustic beamforming is employed to clean up the speech, and the back-end ASR engine is robustified by multicondition training and adaptation. We will also describe the so-called end-to-end approach to ASR, which is a new promising architecture that has recently been extended to the far-field scenario. This tutorial article gives an account of the algorithms used to enable accurate speech recognition from a distance, and it will be seen that, although deep learning has a significant share in the technological breakthroughs, a clever combination with traditional signal processing can lead to surprisingly effective solutions.Keywords
Funding Information
- Google Faculty Research Award
This publication has 143 references indexed in Scilit:
- Design and Implementation of Robot Audition System 'HARK' — Open Source Software for Listening to Three Simultaneous SpeakersAdvanced Robotics, 2010
- On the optimality of ideal binary time–frequency masksSpeech Communication, 2009
- A Robust and Precise Method for Solving the Permutation Problem of Frequency-Domain Blind Source SeparationIEEE Transactions on Speech and Audio Processing, 2004
- Signal enhancement using beamforming and nonstationarity with applications to speechIEEE Transactions on Signal Processing, 2001
- Adaptive filtering in subbands with critical sampling: analysis, experiments, and application to acoustic echo cancellationIEEE Transactions on Signal Processing, 1992
- Speech recognition in noisy environments with the aid of microphone arraysSpeech Communication, 1990
- Phoneme recognition using time-delay neural networksIEEE Transactions on Acoustics, Speech, and Signal Processing, 1989
- A tutorial on hidden Markov models and selected applications in speech recognitionProceedings of the IEEE, 1989
- Inverse filtering of room acousticsIEEE Transactions on Acoustics, Speech, and Signal Processing, 1988
- An alternative approach to linearly constrained adaptive beamformingIEEE Transactions on Antennas and Propagation, 1982