Continual Gradient Low-Rank Projection Fine-Tuning for LLMs
Open Access
- 1 January 2025
- conference paper
- Published by Association for Computational Linguistics (ACL)
- p. 14815-14829
Abstract
Chenxu Wang, Yilin Lyu, Zicheng Sun, Liping Jing. Proceedings of the 63rd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers). 2025.Keywords
All Related Versions
This publication has 18 references indexed in Scilit:
- Continual Learning of Large Language Models: A Comprehensive SurveyACM Computing Surveys, 2025
- Gradient Projection For Continual Parameter- Efficient TuningIEEE Transactions on Pattern Analysis and Machine Intelligence, 2025
- Bayesian Parameter-Efficient Fine-Tuning for Overcoming Catastrophic ForgettingIEEE/ACM Transactions on Audio, Speech, and Language Processing, 2024
- Continual Learning with Scaled Gradient ProjectionProceedings of the AAAI Conference on Artificial Intelligence, 2023
- Adaptive Plasticity Improvement for Continual Learning2023
- Balancing Stability and Plasticity Through Advanced Null Space in Continual Learning2022
- Learning to Prompt for Continual Learning2022
- BitFit: Simple Parameter-efficient Fine-tuning for Transformer-based Masked Language-models2022
- Learning without ForgettingIEEE Transactions on Pattern Analysis and Machine Intelligence, 2017
- Overcoming catastrophic forgetting in neural networksProceedings of the National Academy of Sciences, 2017