Leveraging GPT-4 for Automatic Translation Post-Editing
Authors:
- Amr SharafASAmr Sharaf
- Arul MenezesAMArul Menezes
Preprint
Abstract
While Neural Machine Translation (NMT) represents the leading approach to Machine Translation (MT), the outputs of NMT models still require translation post-editing to rectify errors and enhance quality, particularly under critical settings. In this work, we formalize the task of translation post-editing with Large Language Models (LLMs) and explore the use of GPT-4 to automatically post-edit NMT outputs across several language pairs. Our results demonstrate that GPT-4 is adept at translation post-editing and produces meaningful edits even when the target language is not English. Notably, we achieve state-of-the-art performance on WMT-22 English-Chinese, English-German, Chinese-English and German-English language pairs using GPT-4 based post-editing, as evaluated by state-of-the-art MT quality metrics.Keywords
All Related Versions
This publication has 20 references indexed in Scilit:
- How to Design Translation Prompts for ChatGPT: An Empirical Study2024
- Understanding and Detecting Hallucinations in Neural Machine Translation via Model IntrospectionTransactions of the Association for Computational Linguistics, 2023
- Experts, Errors, and Context: A Large-Scale Study of Human Evaluation for Machine TranslationTransactions of the Association for Computational Linguistics, 2021
- Testing Machine Translation via Referential Transparency2021
- A review of the state-of-the-art in automatic post-editingMachine Translation, 2020
- Machine translation testing via pathological invariance2020
- A roadmap to neural automatic post-editing: an empirical approachMachine Translation, 2020
- Structure-invariant testing for machine translation2020
- Automatic testing and improvement of machine translation2020
- COMET: A Neural Framework for MT Evaluation2020