Evaluating whole-page relevance
Authors:
Open Access
- 19 July 2010
- conference paper
- Published by Association for Computing Machinery (ACM)
- p. 767-768
Abstract
Whole page relevance defines how well the surface-level repre- sentation of all elements on a search result page and the corre- sponding holistic attributes of the presentation respond to users' information needs. We introduce a method for evaluating the whole-page relevance of Web search engine results pages. Our key contribution is that the method allows us to investigate as- pects of component relevance that are difficult or impossible to judge in isolation. Such aspects include component-level infor- mation redundancy and cross-component coherence. The method we describe complements traditional document relevance meas- urement, affords comparative relevance assessment across multi- ple search engines, and facilitates the study of important factors such as brand presentation effects and component-level quality.Keywords
This publication has 5 references indexed in Scilit:
- Including summaries in system evaluation2009
- On test collections for adaptive information retrievalInformation Processing & Management, 2008
- Practical guide to controlled experiments on the web2007
- The influence of caption features on clickthrough patterns in web search2007
- The ASLIB CRANFIELD RESEARCH PROJECT ON The COMPARATIVE EFFICIENCY OF INDEXING SYSTEMSAslib Proceedings, 1960