Beyond Similarity: A Gradient-based Graph Method for Instruction Tuning Data Selection
Authors:
- Yang ZhaoYZYang Zhao
- Xiao DingXDXiao Ding
- Hepeng WangHWHepeng Wang
- Kai XiongKXKai Xiong
- Dongchen LiDLDongchen Li
Open Access
- 1 January 2025
- conference paper
- Published by Association for Computational Linguistics (ACL)
- p. 24391-24404
Abstract
Yang Zhao, Li Du, Xiao Ding, Yangou Ouyang, Hepeng Wang, Kai Xiong, Jinglong Gao, Zhouhao Sun, Dongliang Xu, Qing Yang, Dongchen Li, Bing Qin, Ting Liu. Proceedings of the 63rd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers). 2025.Keywords
This publication has 5 references indexed in Scilit:
- Instruction Tuning for Large Language Models: A SurveyACM Computing Surveys, 2026
- Training data influence analysis and estimation: a surveyMachine Learning, 2024
- Deciphering the Impact of Pretraining Data on Large Language Models through Machine Unlearning2024
- An Experimental Design Framework for Label-Efficient Supervised Finetuning of Large Language Models2024
- Chain-Of-Thought Prompting Elicits Reasoning in Large Language Models2022