ActiShade: Activating Overshadowed Knowledge to Guide Multi-Hop Reasoning in Large Language Models
Authors:
- Huipeng MaHMHuipeng Ma
- Luan ZhangLZLuan Zhang
- Linmei HuLinmei Hu
- Chenhao LiCLChenhao Li
Preprint
Abstract
In multi-hop reasoning, multi-round retrieval-augmented generation (RAG) methods typically rely on LLM-generated content as the retrieval query. However, these approaches are inherently vulnerable to knowledge overshadowing - a phenomenon where critical information is overshadowed during generation. As a result, the LLM-generated content may be incomplete or inaccurate, leading to irrelevant retrieval and causing error accumulation during the iteration process. To address this challenge, we propose ActiShade, which detects and activates overshadowed knowledge to guide large language models (LLMs) in multi-hop reasoning. Specifically, ActiShade iteratively detects the overshadowed keyphrase in the given query, retrieves documents relevant to both the query and the overshadowed keyphrase, and generates a new query based on the retrieved documents to guide the next-round iteration. By supplementing the overshadowed knowledge during the formulation of next-round queries while minimizing the introduction of irrelevant noise, ActiShade reduces the error accumulation caused by knowledge overshadowing. Extensive experiments show that ActiShade outperforms existing methods across multiple datasets and LLMs.Keywords
All Related Versions
This publication has 4 references indexed in Scilit:
- GRITHopper: Decomposition-Free Multi-Hop Dense Retrieval2026
- A Survey on Hallucination in Large Language Models: Principles, Taxonomy, Challenges, and Open QuestionsACM Transactions on Information Systems, 2025
- Survey of Hallucination in Natural Language GenerationACM Computing Surveys, 2023
- ♫ MuSiQue: Multihop Questions via Single-hop Question CompositionTransactions of the Association for Computational Linguistics, 2022