How well does result relevance predict session satisfaction?
Authors:
Open Access
- 23 July 2007
- conference paper
- Published by Association for Computing Machinery (ACM)
- p. 567-574
Abstract
Per-query relevance measures provide standardized, repeatable measurements of search result quality, but they ignore much of what users actually experience in a full search session. This paper examines how well we can approximate a user's ultimate session-level satisfaction using a simple relevance metric. We find that thisrelationship is surprisingly strong. By incorporating additional properties of the query itself, we construct a model which predicts user satisfaction even more accurately than relevance alone.Keywords
This publication has 17 references indexed in Scilit:
- When will information retrieval be "good enough"?2005
- Information retrieval system evaluation2005
- The perfect search engine is not enough2004
- Cumulated gain-based evaluation of IR techniquesACM Transactions on Information Systems, 2002
- A taxonomy of web searchACM SIGIR Forum, 2002
- A user-centered approach to evaluating human interaction with Web search engines: an exploratory studyInformation Processing & Management, 2002
- Evaluation by highly relevant documents2001
- Evaluating evaluation measure stability2000
- Back to Bentham? Explorations of Experienced UtilityThe Quarterly Journal of Economics, 1997
- The significance of the Cranfield tests on index languages1991