Alibaba-Translate China's Submission for WMT 2022 Quality Estimation Shared Task
Preprint
Abstract
In this paper, we present our submission to the sentence-level MQM benchmark at Quality Estimation Shared Task, named UniTE (Unified Translation Evaluation). Specifically, our systems employ the framework of UniTE, which combined three types of input formats during training with a pre-trained language model. First, we apply the pseudo-labeled data examples for the continuously pre-training phase. Notably, to reduce the gap between pre-training and fine-tuning, we use data pruning and a ranking-based score normalization strategy. For the fine-tuning phase, we use both Direct Assessment (DA) and Multidimensional Quality Metrics (MQM) data from past years' WMT competitions. Finally, we collect the source-only evaluation results, and ensemble the predictions generated by two UniTE models, whose backbones are XLM-R and InfoXLM, respectively. Results show that our models reach 1st overall ranking in the Multilingual and English-Russian settings, and 2nd overall ranking in English-German and Chinese-English settings, showing relatively strong performances in this year's quality estimation competition.Keywords
All Related Versions
This publication has 22 references indexed in Scilit:
- Challenges of Neural Machine Translation for Short TextsComputational Linguistics, 2022
- Experts, Errors, and Context: A Large-Scale Study of Human Evaluation for Machine TranslationTransactions of the Association for Computational Linguistics, 2021
- TransQuest: Translation Quality Estimation with Cross-lingual Transformers2020
- Domain Transfer based Data Augmentation for Neural Query Translation2020
- COMET: A Neural Framework for MT Evaluation2020
- Self-Paced Learning for Neural Machine Translation2020
- Unsupervised Cross-lingual Representation Learning at Scale2020
- Uncertainty-Aware Curriculum Learning for Neural Machine Translation2020
- BLEURT: Learning Robust Metrics for Text Generation2020
- The original Borda count and partial votingSocial Choice and Welfare, 2011