Accelerating BERT Inference for Sequence Labeling via Early-Exit

Authors:
  • XLXiaonan Li
    Xiaonan Li
  • YSYunfan Shao
    Yunfan Shao
  • TSTianxiang Sun
    Tianxiang Sun
  • HYHang Yan
    Hang Yan
  • XQXipeng Qiu
    Xipeng Qiu
  • XHXuan-Jing Huang
    Xuan-Jing Huang

Abstract
Xiaonan Li, Yunfan Shao, Tianxiang Sun, Hang Yan, Xipeng Qiu, Xuanjing Huang. Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (Volume 1: Long Papers). 2021.