Federated Learning of Large Language Models with Parameter-Efficient Prompt Tuning and Adaptive Optimization
Open Access
- 1 January 2023
- conference paper
- Published by Association for Computational Linguistics (ACL)
- p. 7871-7888
Abstract
Tianshi Che, Ji Liu, Yang Zhou, Jiaxiang Ren, Jiwen Zhou, Victor Sheng, Huaiyu Dai, Dejing Dou. Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing. 2023.Keywords
All Related Versions
This publication has 18 references indexed in Scilit:
- HeterPS: Distributed deep learning with reinforcement learning based scheduling in heterogeneous environmentsFuture Generation Computer Systems, 2023
- A hierarchical federated learning model with adaptive model parameter aggregationComputer Science and Information Systems, 2023
- Large‐scale knowledge distillation with elastic heterogeneous computing resourcesConcurrency and Computation: Practice and Experience, 2022
- Neural Network Acceptability JudgmentsTransactions of the Association for Computational Linguistics, 2019
- BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding2019
- Efficient Scheduling of Scientific Workflows Using Hot Metadata in a Multisite CloudIEEE Transactions on Knowledge and Data Engineering, 2018
- Lightweight Indexing and Querying Services for Big Spatial DataIEEE Transactions on Services Computing, 2016
- Multi-objective scheduling of Scientific Workflows in multisite cloudsFuture Generation Computer Systems, 2016
- A Survey of Data-Intensive Scientific Workflow ManagementJournal of Grid Computing, 2015
- Building a question answering test collection2000