Quantifying the Effect of Machine Translation in a High-Quality Human Translation Production Process
Open Access
- 23 April 2020
- journal article
- research article
- Published by MDPI AG in Informatics
- Vol. 7 (2) , 12
Abstract
This paper studies the impact of machine translation (MT) on the translation workflow at the Directorate-General for Translation (DGT), focusing on two language pairs and two MT paradigms: English-into-French with statistical MT and English-into-Finnish with neural MT. We collected data from 20 professional translators at DGT while they carried out real translation tasks in normal working conditions. The participants enabled/disabled MT for half of the segments in each document. They filled in a survey at the end of the logging period. We measured the productivity gains (or losses) resulting from the use of MT and examined the relationship between technical effort and temporal effort. The results show that while the usage of MT leads to productivity gains on average, this is not the case for all translators. Moreover, the two technical effort indicators used in this study show weak correlations with post-editing time. The translators’ perception of their speed gains was more or less in line with the actual results. Reduction of typing effort is the most frequently mentioned reason why participants preferred working with MT, but also the psychological benefits of not having to start from scratch were often mentioned.Keywords
This publication has 15 references indexed in Scilit:
- Correlation Coefficients: Appropriate Use and InterpretationAnesthesia & Analgesia, 2018
- Translation Methods and Experience: A Comparative Analysis of Human Translation and Post-editing with Students and Professional TranslatorsMeta : Journal Des Traducteursmeta : / Translators’ Journal, 2017
- Identifying the Machine Translation Error Types with the Greatest Impact on Post-editing EffortFrontiers in Psychology, 2017
- Resistance and accommodation: factors for the (non-) adoption of machine translation among professional translatorsPerspectives, 2017
- Correlations of perceived post-editing effort with measurements of actual effortMachine Translation, 2015
- CASMACAT: An Open Source Workbench for Advanced Computer Aided TranslationThe Prague Bulletin of Mathematical Linguistics, 2013
- Towards predicting post-editing productivityMachine Translation, 2011
- Eye tracking as an MT evaluation techniqueMachine Translation, 2010
- A Productivity Test of Statistical Machine Translation Post-Editing in a Typical Localisation ContextThe Prague Bulletin of Mathematical Linguistics, 2010
- Pauses as Indicators of Cognitive Effort in Post-editing Machine Translation OutputAcross Languages and Cultures, 2006