What Language Model to Train if You Have One Million GPU Hours?
Authors:
- Teven Le ScaoTSTeven Le Scao
- Thomas WangTWThomas Wang
- Daniel HesslowDHDaniel Hesslow
- Stas BekmanSBStas Bekman
- M Saiful BariMBM Saiful Bari
- Stella BidermanSBStella Biderman
- Hady ElsaharHEHady Elsahar
- Niklas MuennighoffNMNiklas Muennighoff
- Jason PhangJPJason Phang
- Ofir PressOPOfir Press
- Colin RaffelCRColin Raffel
- Victor SanhVSVictor Sanh
Open Access
- 1 January 2022
- conference paper
- Published by Association for Computational Linguistics (ACL)
- p. 765-782