Retrieving Passages and Finding Answers
Authors:
Open Access
- 26 November 2014
- conference paper
- Published by Association for Computing Machinery (ACM)
- p. 81-84
Abstract
Retrieving topically-relevant text passages in documents has been studied many times, but finding non-factoid, multiple sentence answers to web queries is a different task that is becoming increasingly important for applications such as mobile search. As the first stage of developing retrieval models for "answer passages", we describe the process of creating a test collection of questions and multiple-sentence answers based on the TREC GOV2 queries and documents. This annotation shows that most of the description-length TREC queries do in fact have passage-level answers. We then examine the effectiveness of current passage retrieval models in terms of finding passages that contain answers. We show that the existing methods are not effective for this task, and also observe that the relative performance of these methods in retrieving answers does not correspond to their performance in retrieving relevant documents.Keywords
Funding Information
- Defense Advanced Research Projects Agency (HR001-12-C-0015)
- Australian Research Council (DP140102655)
This publication has 11 references indexed in Scilit:
- Position-based contextualization for passage retrieval2013
- Learning to Rank Answers to Non-Factoid Questions from Web CollectionsComputational Linguistics, 2011
- Utilizing Passage-Based Language Models for Document Retrieval2008
- INEX 2007 Evaluation Measures2008
- A Markov random field model for term dependencies2005
- HARD Track Overview in TREC 2004: High Accuracy Retrieval from Documents2004
- Passage retrieval based on language models2002
- Passage retrieval based on language models2002
- Relevance based language models2001
- Passage-Level Evidence in Document Retrieval1994