Efficient Domain Continual pretraining by Mitigating the Stability Gap
Top Cited Papers
Open Access
- 1 January 2025
- conference paper
- Published by Association for Computational Linguistics (ACL)
- p. 32850-32870
Abstract
Yiduo Guo, Jie Fu, Huishuai Zhang, Dongyan Zhao. Proceedings of the 63rd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers). 2025.Keywords
All Related Versions
This publication has 20 references indexed in Scilit:
- PMC-LLaMA: toward building open-source language models for medicineJournal of the American Medical Informatics Association, 2024
- MedAdapter: Efficient Test-Time Adaptation of Large Language Models Towards Medical Reasoning2024
- Instruction-tuned Language Models are Better Knowledge Learners2024
- PPTC Benchmark: Evaluating Large Language Models for PowerPoint Task Completion2024
- BioMistral: A Collection of Open-Source Pretrained Large Language Models for Medical Domains2024
- Is ChatGPT a General-Purpose Natural Language Processing Task Solver?2023
- Adapting a Language Model While Preserving its General Knowledge2022
- Continued Pretraining for Better Zero- and Few-Shot Promptability2022
- BioNLI: Generating a Biomedical NLI Dataset Using Lexico-semantic Constraints for Adversarial Examples2022
- Automatic semantic classification of scientific literature according to the hallmarks of cancerBioinformatics, 2015