MoEfication: Transformer Feed-forward Layers are Mixtures of Experts
Authors:
- Zhengyan ZhangZZZhengyan Zhang
- Yankai LinYLYankai Lin
- Zhiyuan LiuZLZhiyuan Liu
- Peng LiPLPeng Li
- Maosong SunMSMaosong Sun
- Jie ZhouJZJie Zhou
Top Cited Papers
Open Access
- 1 January 2022
- conference paper
- Published by Association for Computational Linguistics (ACL)
- p. 877-890