Improving Multi-hop Knowledge Base Question Answering by Learning Intermediate Supervision Signals
Authors:
Top Cited Papers
Open Access
- 8 March 2021
- conference paper
- Published by Association for Computing Machinery (ACM)
- p. 553-561
Abstract
Multi-hop Knowledge Base Question Answering (KBQA) aims to find the answer entities that are multiple hops away in the Knowl- edge Base (KB) from the entities in the question. A major challenge is the lack of supervision signals at intermediate steps. Therefore, multi-hop KBQA algorithms can only receive the feedback from the final answer, which makes the learning unstable or ineffective. To address this challenge, we propose a novel teacher-student approach for the multi-hop KBQA task. In our approach, the stu- dent network aims to find the correct answer to the query, while the teacher network tries to learn intermediate supervision signals for improving the reasoning capacity of the student network. The major novelty lies in the design of the teacher network, where we utilize both forward and backward reasoning to enhance the learning of intermediate entity distributions. By considering bidi- rectional reasoning, the teacher network can produce more reliable intermediate supervision signals, which can alleviate the issue of spurious reasoning. Extensive experiments on three benchmark datasets have demonstrated the effectiveness of our approach on the KBQA task.Keywords
All Related Versions
This publication has 9 references indexed in Scilit:
- Self-Supervised Visual Feature Learning With Deep Neural Networks: A SurveyIEEE Transactions on Pattern Analysis and Machine Intelligence, 2020
- Stepwise Reasoning for Multi-Relation Question Answering over Knowledge Graph with Weak Supervision2020
- Query Graph Generation for Answering Multi-hop Complex Questions from Knowledge Bases2020
- Multi-hop Knowledge Base Question Answering with an Iterative Sequence Matching Model2019
- Multi-hop Reading Comprehension through Question Decomposition and Rescoring2019
- Question Answering on Freebase via Relation Extraction and Textual Evidence2016
- Question Answering over Freebase with Multi-Column Convolutional Neural Networks2015
- Building Watson: An Overview of the DeepQA ProjectAI Magazine, 2010
- Jensen-Shannon divergence and Hilbert space embedding2004