Evaluating Arabic to English Machine Translation
Authors:
- Laith S.LSLaith S.
- Taghreed M.TMTaghreed M.
- Mohammed N.MNMohammed N.
Open Access
- 1 January 2014
- journal article
- Published by The Science and Information Organization in International Journal of Advanced Computer Science and Applications
- Vol. 5 (11)
Abstract
Online text machine translation systems are widely used throughout the world freely. Most of these systems use statistical machine translation (SMT) that is based on a corpus full with translation examples to learn from them how to translate correctly. Online text machine translation systems differ widely in their effectiveness, and therefore we have to fairly evaluate their effectiveness. Generally the manual (human) evaluation of machine translation (MT) systems is better than the automatic evaluation, but it is not feasible to be used. The distance or similarity of MT candidate output to a set of reference translations are used by many MT evaluation approaches. This study presents a comparison of effectiveness of two free online machine translation systems (Google Translate and Babylon machine translation system) to translate Arabic to English. There are many automatic methods used to evaluate different machine translators, one of these methods; Bilingual Evaluation Understudy (BLEU) method. BLEU is used to evaluate translation quality of two free online machine translation systems under consideration. A corpus consists of more than 1000 Arabic sentences with two reference English translations for each Arabic sentence is used in this study. This corpus of Arabic sentences and their English translations consists of 4169 Arabic words, where the number of unique Arabic words is 2539. This corpus is released online to be used by researchers. These Arabic sentences are distributed among four basic sentence functions (declarative, interrogative, exclamatory, and imperative). The experimental results show that Google machine translation system is better than Babylon machine translation system in terms of precision of translation from Arabic to English.Keywords
This publication has 8 references indexed in Scilit:
- A conjoint analysis framework for evaluating user preferences in machine translationMachine Translation, 2013
- Arabic machine translation: a surveyArtificial Intelligence Review, 2012
- Evaluation of 2-way Iraqi Arabic–English speech translation systems using automated metricsMachine Translation, 2011
- The impact of Arabic morphological segmentation on broad-coverage English-to-Arabic statistical machine translationMachine Translation, 2011
- Linguistic measures for automatic machine translation evaluationMachine Translation, 2010
- Building an English-iraqi Arabic machine translation system for spoken utterances with limited resources2006
- A Reference Grammar of Modern Standard Arabic2005
- A Methodology for Evaluating Arabic Machine Translation SystemsMachine Translation, 2004