Improving ASR by integrating lecture audio and slides
Authors:
- 1 May 2013
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- No. 15206149,p. 8131-8135
Abstract
We propose a method to combine audio of a lecture with its supporting slides in order to improve automatic speech recognition performance. We view both the lecture speech and the slides as parallel streams which contain redundant information. We integrate both streams in order to bias the recognizer's language model towards the words in the slides, by first aligning the speech with the slide words, thus correcting errors on the ASR transcripts. We obtain a 5.9% relative WER improvement on a lecture test set, when compared to a speech recognition only system.Keywords
This publication has 8 references indexed in Scilit:
- Recovery of acronyms, out-of-lattice words and pronunciations from parallel multilingual speech2012
- Parallel combination of multilingual speech streams for improved ASR2012
- Improving and Aligning Speech with Presentation Slides2010
- Integration of Statistical Models for Dictation of Document Translations in a Machine-Aided Human Translation TaskIEEE Transactions on Audio, Speech, and Language Processing, 2010
- Integration of Speech Recognition and Machine Translation in Computer-Assisted TranslationIEEE Transactions on Audio, Speech, and Language Processing, 2008
- Extracting clues from human interpreter speech for spoken language translationInternational Conference on Acoustics, Speech, and Signal Processing (ICASSP), 2008
- Toward better retrieval and presentation by exploring cross-media correlationsMultimedia Systems, 2005
- Speech translation enhanced automatic speech recognition2005