Revisiting Token Dropping Strategy in Efficient BERT Pretraining
Authors:
- Qihuang ZhongQZQihuang Zhong
- Liang DingLDLiang Ding
- Juhua LiuJLJuhua Liu
- Xuebo LiuXLXuebo Liu
- Min ZhangMZMin Zhang
- Bo DuBDBo Du
- Dacheng TaoDTDacheng Tao
Open Access
- 1 January 2023
- conference paper
- Published by Association for Computational Linguistics (ACL)
- p. 10391-10405