Learning to find answers to questions on the Web
Authors:
Open Access
- 1 May 2004
- journal article
- Published by Association for Computing Machinery (ACM) in ACM Transactions on Internet Technology
- Vol. 4 (2) , 129-162
Abstract
We introduce a method for learning to find documents on the Web that contain answers to a given natural language question. In our approach, questions are transformed into new queries aimed at maximizing the probability of retrieving answers from existing information retrieval systems. The method involves automatically learning phrase features for classifying questions into different types, automatically generating candidate query transformations from a training set of question/answer pairs, and automatically evaluating the candidate transformations on target information retrieval systems such as real-world general purpose search engines. At run-time, questions are transformed into a set of queries, and reranking is performed on the documents retrieved. We present a prototype search engine,Tritus, that applies the method to Web search engines. Blind evaluation on a set of real queries from a Web search engine log shows that the method significantly outperforms the underlying search engines, and outperforms a commercial search engine specializing in question answering. Our methodology cleanly supports combining documents retrieved from different search engines, resulting in additional improvement with a system that combines search results from multiple Web search engines.Keywords
This publication has 13 references indexed in Scilit:
- Combining Approaches to Information Retrieval2005
- Experiments in automated lexicon building for text searching2000
- Experiments with open-domain textual Question Answering2000
- Examining the role of statistical and linguistic knowledge sources in a general-knowledge question-answering system2000
- Results and challenges in Web search evaluationComputer Networks, 1999
- The anatomy of a large-scale hypertextual Web search engineComputer Networks and ISDN Systems, 1998
- Context and page analysis for improved Web searchIEEE Internet Computing, 1998
- WordNetCommunications of the ACM, 1995
- ON TERM SELECTION FOR QUERY EXPANSIONJournal of Documentation, 1990
- Relevance weighting of search termsJournal of the American Society for Information Science, 1976