Predicting IR Personalization Performance using Pre-retrieval Query Predictors
Authors:
Preprint
Abstract
Personalization generally improves the performance of queries but in a few cases it may also harms it. If we are able to predict and therefore to disable personalization for those situations, the overall performance will be higher and users will be more satisfied with personalized systems. We use some state-of-the-art pre-retrieval query performance predictors and propose some others including the user profile information for the previous purpose. We study the correlations among these predictors and the difference between the personalized and the original queries. We also use classification and regression techniques to improve the results and finally reach a bit more than one third of the maximum ideal performance. We think this is a good starting point within this research line, which certainly needs more effort and improvements.Keywords
All Related Versions
This publication has 12 references indexed in Scilit:
- Use of textual and conceptual profiles for personalized retrieval of political documentsKnowledge-Based Systems, 2016
- Measuring and Predicting Search Engine Users’ SatisfactionACM Computing Surveys, 2016
- An automatic methodology to evaluate personalized information retrieval systemsUser Modeling and User-Adapted Interaction, 2014
- Using Personalization to Improve XML RetrievalIEEE Transactions on Knowledge and Data Engineering, 2013
- A comparative survey of Personalised Information Retrieval and Adaptive Hypermedia techniquesInformation Processing & Management, 2012
- Personalised Information Retrieval: survey and classificationUser Modeling and User-Adapted Interaction, 2012
- Predicting Query Performance by Query-Drift EstimationACM Transactions on Information Systems, 2012
- Predicting the effectiveness of queries and retrieval systemsACM SIGIR Forum, 2010
- Evaluating information retrieval system performance based on user preferenceJournal of Intelligent Information Systems, 2009
- Personalized web search for improving retrieval effectivenessIEEE Transactions on Knowledge and Data Engineering, 2004