Cloze-driven Pretraining of Self-attention Networks

Authors:
  • ABAlexei Baevski
    Alexei Baevski
  • SESergey Edunov
    Sergey Edunov
  • YLYinhan Liu
    Yinhan Liu
  • LZLuke Zettlemoyer
    Luke Zettlemoyer
  • MAMichael Auli
    Michael Auli

Top Cited Papers
Open Access
Abstract
Alexei Baevski, Sergey Edunov, Yinhan Liu, Luke Zettlemoyer, Michael Auli. Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP). 2019.