Pattern Shifting or Knowledge Losing? A Forgetting Perspective for Understanding the Effect of Instruction Fine-Tuning
- 29 November 2024
- book chapter
- Published by Springer Nature
- p. 540-554
Abstract
No abstract availableKeywords
This publication has 14 references indexed in Scilit:
- PyTorch FSDP: Experiences on Scaling Fully Sharded Data ParallelProceedings of the VLDB Endowment, 2023
- Finetune like you pretrain: Improved finetuning of zero-shot vision models2023
- Fine-tuned Language Models are Continual Learners2022
- InstructDial: Improving Zero and Few-shot Generalization in Dialogue through Instruction Tuning2022
- Efficient, Uncertainty-based Moderation of Neural Networks Text Classifiers2022
- Co2L: Contrastive Continual Learning2021
- iCaRL: Incremental Classifier and Representation Learning2017
- Overcoming catastrophic forgetting in neural networksProceedings of the National Academy of Sciences of the United States of America, 2017
- Catastrophic forgetting in connectionist networksTrends in Cognitive Sciences, 1999
- Catastrophic Interference in Connectionist Networks: The Sequential Learning Problem1989