LegoMT2: Selective Asynchronous Sharded Data Parallel Training for Massive Neural Machine Translation
Open Access
- 1 January 2025
- conference paper
- Published by Association for Computational Linguistics (ACL)
- p. 23359-23376
Abstract
Fei Yuan, Yinquan Lu, Lei Li, Jingjing Xu. Findings of the Association for Computational Linguistics: ACL 2025. 2025.Keywords
This publication has 4 references indexed in Scilit:
- The Flores-101 Evaluation Benchmark for Low-Resource and Multilingual Machine TranslationTransactions of the Association for Computational Linguistics, 2022
- FlashAttention: Fast and Memory-Efficient Exact Attention with IO-Awareness2022
- Evaluating the Cross-Lingual Effectiveness of Massively Multilingual Neural Machine TranslationProceedings of the AAAI Conference on Artificial Intelligence, 2020
- Simple, Scalable Adaptation for Neural Machine Translation2019