First is Not Really Better Than Last: Evaluating Layer Choice and Aggregation Strategies in Language Model Data Influence Estimation
Preprint
Abstract
Identifying how training samples influence/impact Large Language Model (LLM) decision-making is essential for effectively interpreting model decisions and auditing large-scale datasets. Current training sample influence estimation methods (also known as influence functions) undertake this goal by utilizing information flow through the model via its first-order and higher-order gradient terms. However, owing to the large model sizes of today consisting of billions of parameters, these influence computations are often restricted to some subset of model layers to ensure computational feasibility. Prior seminal work by Yeh et al. (2022) in assessing which layers are best suited for computing language data influence concluded that the first (embedding) layers are the most informative for this purpose, using a hypothesis based on influence scores canceling out (i.e., the cancellation effect). In this work, we propose theoretical and empirical evidence demonstrating how the cancellation effect is unreliable, and that middle attention layers are better estimators for influence. Furthermore, we address the broader challenge of aggregating influence scores across layers, and showcase how alternatives to standard averaging (such as ranking and vote-based methods) can lead to significantly improved performance. Finally, we propose better methods for evaluating influence score efficacy in LLMs without undertaking model retraining, and propose a new metric known as the Noise Detection Rate (NDR) that exhibits strong predictive capability compared to the cancellation effect. Through extensive experiments across LLMs of varying types and scales, we concretely determine that the first (layers) are not necessarily better than the last (layers) for LLM influence estimation, contrasting with prior knowledge in the field.Keywords
All Related Versions
This publication has 13 references indexed in Scilit:
- Generalization bias in large language model summarization of scientific researchRoyal Society Open Science, 2025
- Large language models can outperform humans in social situational judgmentsScientific Reports, 2024
- Bias and Fairness in Large Language Models: A SurveyComputational Linguistics, 2024
- Generalized Out-of-Distribution Detection: A SurveyInternational Journal of Computer Vision, 2024
- Training data influence analysis and estimation: a surveyMachine Learning, 2024
- Scaling Up Influence FunctionsProceedings of the AAAI Conference on Artificial Intelligence, 2022
- Combining Feature and Instance Attribution to Detect Artifacts2022
- Influence Selection for Active Learning2021
- Explaining Black Box Predictions and Unveiling Data Artifacts through Influence Functions2020
- Finding label noise examples in large scale datasets2017