Re-translation versus Streaming for Simultaneous Translation
Preprint
Abstract
There has been great progress in improving streaming machine translation, a simultaneous paradigm where the system appends to a growing hypothesis as more source content becomes available. We study a related problem in which revisions to the hypothesis beyond strictly appending words are permitted. This is suitable for applications such as live captioning an audio feed. In this setting, we compare custom streaming approaches to re-translation, a straightforward strategy where each new source token triggers a distinct translation from scratch. We find re-translation to be as good or better than state-of-the-art streaming systems, even when operating under constraints that allow very few revisions. We attribute much of this success to a previously proposed data-augmentation technique that adds prefix-pairs to the training data, which alongside wait-k inference forms a strong baseline for streaming translation. We also highlight re-translation's ability to wrap arbitrarily powerful MT systems with an experiment showing large improvements from an upgrade to its base model.Keywords
All Related Versions
This publication has 7 references indexed in Scilit:
- Re-Translation Strategies for Long Form, Simultaneous, Spoken Language Translation2020
- Simpler and Faster Learning of Adaptive Policies for Simultaneous Translation2019
- Speculative Beam Search for Simultaneous Translation2019
- Monotonic Infinite Lookback Attention for Simultaneous Machine Translation2019
- STACL: Simultaneous Translation with Implicit Anticipation and Controllable Latency using Prefix-to-Prefix Framework2019
- Incremental Decoding and Training Methods for Simultaneous Translation in Neural Machine Translation2018
- Neural Machine Translation of Rare Words with Subword Units2016