Communication-Efficient and Tensorized Federated Fine-Tuning of Large Language Models
Open Access
- 1 January 2025
- conference paper
- Published by Association for Computational Linguistics (ACL)
- p. 24192-24207
Abstract
Sajjad Ghiasvand, Yifan Yang, Zhiyu Xue, Mahnoosh Alizadeh, Zheng Zhang, Ramtin Pedarsani. Findings of the Association for Computational Linguistics: ACL 2025. 2025.Keywords
All Related Versions
This publication has 16 references indexed in Scilit:
- Robust Decentralized Learning With Local Updates and Gradient TrackingIEEE Transactions on Networking, 2025
- Federated Large Language Model: Solutions, Challenges and Future DirectionsIEEE Wireless Communications, 2024
- Parameter-efficient fine-tuning of large-scale pre-trained language modelsNature Machine Intelligence, 2023
- Federated Learning of Large Language Models with Parameter-Efficient Prompt Tuning and Adaptive Optimization2023
- Parameter-Efficient Fine-Tuning without Introducing New Latency2023
- SparseAdapter: An Easy Approach for Improving the Parameter-Efficiency of Adapters2022
- BitFit: Simple Parameter-efficient Fine-tuning for Transformer-based Masked Language-models2022
- BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding2019
- A Broad-Coverage Challenge Corpus for Sentence Understanding through Inference2018
- SQuAD: 100,000+ Questions for Machine Comprehension of Text2016