Multilingual Language Model Pretraining using Machine-translated Data

Authors:
  • JWJiayi Wang
    Jiayi Wang
  • YLYao Lu
    Yao Lu
  • MWMaurice Weber
    Maurice Weber
  • MRMax Ryabinin
    Max Ryabinin
  • DADavid Ifeoluwa Adelani
    David Ifeoluwa Adelani
  • YCYihong Chen
    Yihong Chen
  • RTRaphael Tang
    Raphael Tang
  • PSPontus Stenetorp
    Pontus Stenetorp

Abstract
Jiayi Wang, Yao Lu, Maurice Weber, Max Ryabinin, David Ifeoluwa Adelani, Yihong Chen, Raphael Tang, Pontus Stenetorp. Proceedings of the 2025 Conference on Empirical Methods in Natural Language Processing. 2025.