Scaling Language Model Size in Cross-Device Federated Learning

Authors:
  • JRJae Ro
    Jae Ro
  • TBTheresa Breiner
    Theresa Breiner
  • LMLara McConnaughey
    Lara McConnaughey
  • MCMingqing Chen
    Mingqing Chen
  • ASAnanda Suresh
    Ananda Suresh
  • SKShankar Kumar
    Shankar Kumar
  • RMRajiv Mathews
    Rajiv Mathews

Abstract
Jae Ro, Theresa Breiner, Lara McConnaughey, Mingqing Chen, Ananda Suresh, Shankar Kumar, Rajiv Mathews. Proceedings of the First Workshop on Federated Learning for Natural Language Processing (FL4NLP 2022). 2022.