A Neural Click Model for Web Search
Open Access
- 11 April 2016
- conference paper
- Published by Association for Computing Machinery (ACM)
- p. 531-541
Abstract
Understanding user browsing behavior in web search is key to improving web search effectiveness. Many click models have been proposed to explain or predict user clicks on search engine results. They are based on the probabilistic graphical model (PGM) framework, in which user behavior is represented as a sequence of observable and hidden events. The PGM framework provides a mathematically solid way to reason about a set of events given some information about other events. But the structure of the dependencies between the events has to be set manually. Different click models use different hand-crafted sets of dependencies. We propose an alternative based on the idea of distributed representations: to represent the user's information need and the information available to the user with a vector state. The components of the vector state are learned to represent concepts that are useful for modeling user behavior. And user behavior is modeled as a sequence of vector states associated with a query session: the vector state is initialized with a query, and then iteratively updated based on information about interactions with the search engine results. This approach allows us to directly understand user browsing behavior from click-through data, i.e., without the need for a predefined set of rules as is customary for PGM-based click models. We illustrate our approach using a set of neural click models. Our experimental results show that the neural click model that uses the same training data as traditional PGM-based click models, has better performance on the click prediction task (i.e., predicting user click on search engine results) and the relevance prediction task (i.e., ranking documents by their relevance to a query). An analysis of the best performing neural click model shows that it learns similar concepts to those used in traditional click models, and that it also learns other concepts that cannot be designed manually.Keywords
Funding Information
- Netherlands Organisation for Scientific Research (NWO) (612.001.116, CI-14-25, 612.001.551, HOR-11-10, 640.006.013, 612.066.930, SH-322-15, 652.002.001)
- Swiss National Science Foundation (P2T1P2_152269)
- Amsterdam Data Science
- Netherlands Institute for Sound and Vision (727.011.005)
- Netherlands eScience Center (027.012.105)
- Dutch national program COMMIT
This publication has 29 references indexed in Scilit:
- A Comparative Study of Click Models for Web Search2015
- An Introduction to Click Models for Web Search2015
- Click Models for Web SearchSynthesis Lectures on Information Concepts, Retrieval, and Services, 2015
- Click model-based information retrieval metrics2013
- Using Intent Information to Model User Behavior in Diversified Search2013
- Beyond ten blue links2012
- Personalized click model through collaborative filtering2012
- Learning Deep Architectures for AIFoundations and Trends in Machine Learning, 2009
- Framewise phoneme classification with bidirectional LSTM and other neural network architecturesNeural Networks, 2005
- Long Short-Term MemoryNeural Computation, 1997