Continued Pretraining for Better Zero- and Few-Shot Promptability

Authors:
  • ZWZhaofeng Wu
    Zhaofeng Wu
  • RIRobert L Logan Iv
    Robert L Logan Iv
  • PWPete Walsh
    Pete Walsh
  • ABAkshita Bhagia
    Akshita Bhagia
  • DGDirk Groeneveld
    Dirk Groeneveld
  • SSSameer Singh
    Sameer Singh
  • IBIz Beltagy
    Iz Beltagy

Abstract
Zhaofeng Wu, Robert L Logan IV, Pete Walsh, Akshita Bhagia, Dirk Groeneveld, Sameer Singh, Iz Beltagy. Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing. 2022.