Using Sublexical Translations to Handle the OOV Problem in Machine Translation
Authors:
Open Access
- 1 September 2011
- journal article
- Published by Association for Computing Machinery (ACM) in ACM Transactions on Asian Language Information Processing
- Vol. 10 (3) , 1-20
Abstract
We introduce a method for learning to translate out-of-vocabulary (OOV) words. The method focuses on combining sublexical/constituent translations of an OOV to generate its translation candidates. In our approach, wildcard searches are formulated based on our OOV analysis, aimed at maximizing the probability of retrieving OOVs’ sublexical translations from existing resources of Machine Translation (MT) systems. At run-time, translation candidates of the unknown words are generated from their suitable sublexical translations and ranked based on monolingual and bilingual information. We have incorporated the OOV model into a state-of-the-art machine translation system and experimental results show that our model indeed helps to ease the impact of OOVs on translation quality, especially for sentences containing more OOVs (significant improvement).Keywords
This publication has 11 references indexed in Scilit:
- Chinese2006
- Improving Machine Translation Performance by Exploiting Non-Parallel CorporaComputational Linguistics, 2005
- A Systematic Comparison of Various Statistical Alignment ModelsComputational Linguistics, 2003
- Empirical methods for compound splitting2003
- Introduction to CKIP Chinese word segmentation system for the first international Chinese Word Segmentation Bakeoff2003
- Base Noun Phrase translation using web data and the EM algorithm2002
- Using the web as a bilingual dictionary2001
- BLEU2001
- Machine transliteration1997
- WordNetCommunications of the ACM, 1995