Linguistic-Relationships-Based Approach for Improving Word Alignment
Open Access
- 14 October 2017
- journal article
- research article
- Published by Association for Computing Machinery (ACM) in ACM Transactions on Asian and Low-Resource Language Information Processing
- Vol. 17 (1) , 1-16
Abstract
The unsupervised word alignments (such as GIZA++) are widely used in the phrase-based statistical machine translation. The quality of the model is proportional to the size and the quality of the bilingual corpus. However, for low-resource language pairs such as Chinese and Vietnamese, a result of unsupervised word alignment sometimes is of low quality due to the sparse data. In addition, this model does not take advantage of the linguistic relationships to improve performance of word alignment. Chinese and Vietnamese have the same language type and have close linguistic relationships. In this article, we integrate the characteristics of linguistic relationships into the word alignment model to enhance the quality of Chinese-Vietnamese word alignment. These linguistic relationships are Sino-Vietnamese and content word. The experimental results showed that our method improved the performance of word alignment as well as the quality of machine translation.Keywords
This publication has 10 references indexed in Scilit:
- Multi-Task Word Alignment Triangulation for Low-Resource Languages2015
- Leveraging Small Multilingual Corpora for SMT Using Many Pivot Languages2015
- Refining Word Segmentation Using a Manually Aligned Corpus for Statistical Machine Translation2014
- Improving Word Alignment using Word Similarity2014
- Statistical Machine Translation2009
- Improved statistical machine translation for resource-poor languages using related resource-rich languages2009
- Pivot language approach for phrase-based statistical machine translationMachine Translation, 2007
- A maximum entropy approach for vietnamese word segmentation2006
- A Systematic Comparison of Various Statistical Alignment ModelsComputational Linguistics, 2003
- HMM-based word alignment in statistical translation1996