Integration of Speech Recognition and Machine Translation in Computer-Assisted Translation
Authors:
- 21 October 2008
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Audio, Speech, and Language Processing
- Vol. 16 (8) , 1551-1564
Abstract
Parallel integration of automatic speech recognition (ASR) models and statistical machine translation (MT) models is an unexplored research area in comparison to the large amount of works done on integrating them in series, i.e., speech-to-speech translation. Parallel integration of these models is possible when we have access to the speech of a target language text and to its corresponding source language text, like a computer-assisted translation system. To our knowledge, only a few methods for integrating ASR models with MT models in parallel have been studied. In this paper, we systematically study a number of different translation models in the context of the N-best list rescoring. As an alternative to the N -best list rescoring, we use ASR word graphs in order to arrive at a tighter integration of ASR and MT models. The experiments are carried out on two tasks: English-to-German with an ASR vocabulary size of 17 K words, and Spanish-to-English with an ASR vocabulary of 58 K words. For the best method, the MT models reduce the ASR word error rate by a relative of 18% and 29% on the 17 K and the 58 K tasks, respectively.Keywords
This publication has 20 references indexed in Scilit:
- The Alignment Template Approach to Statistical Machine TranslationComputational Linguistics, 2004
- A Systematic Comparison of Various Statistical Alignment ModelsComputational Linguistics, 2003
- Efficient search for interactive statistical machine translation2003
- Discriminative model combination2002
- Generation of word graphs in statistical machine translation2002
- Recent improvements of the RWTH large vocabulary speech recognition system on spontaneous speech2000
- Translation with Finite-State Devices1998
- A word graph algorithm for large vocabulary continuous speech recognitionComputer Speech & Language, 1997
- HMM-based word alignment in statistical translation1996
- Automatic speech recognition in machine-aided translationComputer Speech & Language, 1994