Finetuning Pretrained Transformers into RNNs

Authors:
  • JKJungo Kasai
    Jungo Kasai
  • HPHao Peng
    Hao Peng
  • YZYizhe Zhang
    Yizhe Zhang
  • DYDani Yogatama
    Dani Yogatama
  • GIGabriel Ilharco
    Gabriel Ilharco
  • NPNikolaos Pappas
    Nikolaos Pappas
  • YMYi Mao
    Yi Mao
  • WCWeizhu Chen
    Weizhu Chen
  • NSNoah A. Smith
    Noah A. Smith
Open Access
Publisher website
Google Scholar
Abstract
Jungo Kasai, Hao Peng, Yizhe Zhang, Dani Yogatama, Gabriel Ilharco, Nikolaos Pappas, Yi Mao, Weizhu Chen, Noah A. Smith. Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing. 2021.