The Stability-Efficiency Dilemma: Investigating Sequence Length Warmup for Training GPT Models
Authors:
- Conglong LiCLConglong Li
- Minjia ZhangMZMinjia Zhang
- Yuxiong HeYHYuxiong He
- 1 January 2022
- conference paper
- Published by Curran Associates, Inc.
- p. 26736-26750