Efficient Index-Based Snippet Generation
Authors:
Open Access
- 1 April 2014
- journal article
- Published by Association for Computing Machinery (ACM) in ACM Transactions on Information Systems
- Vol. 32 (2) , 1-24
Abstract
Ranked result lists with query-dependent snippets have become state of the art in text search. They are typically implemented by searching, at query time, for occurrences of the query words in the top-ranked documents. This document-based approach has three inherent problems: (i) when a document is indexed by terms which it does not contain literally (e.g., related words or spelling variants), localization of the corresponding snippets becomes problematic; (ii) each query operator (e.g., phrase or proximity search) has to be implemented twice, on the index side in order to compute the correct result set, and on the snippet-generation side to generate the appropriate snippets; and (iii) in a worst case, the whole document needs to be scanned for occurrences of the query words, which could be problematic for very long documents. We present a new index-based method that localizes snippets by information solely computed from the index and that overcomes all three problems. Unlike previous index-based methods, we show how to achieve this at essentially no extra cost in query processing time, by a technique we call operator inversion . We also show how our index-based method allows the caching of individual segments instead of complete documents, which enables a significantly larger cache hit-ratio as compared to the document-based approach. We have fully integrated our implementation with the CompleteSearch engine.Keywords
This publication has 20 references indexed in Scilit:
- Caching query-biased snippets for efficient retrieval2011
- Fast error-tolerant search on very large texts2009
- Efficient interactive query expansion with complete search2007
- ESTER2007
- Pruned query evaluation using pre-computed impacts2006
- Type less, find more2006
- Why current IR engines fail2004
- A task-oriented study on the influencing effects of query-biased summarisation in web searchingInformation Processing & Management, 2002
- Shortest-substring retrieval and rankingACM Transactions on Information Systems, 2000
- An Algebra for Structured Text Search and a Framework for its ImplementationThe Computer Journal, 1995