Discovering tasks from search engine query logs
Open Access
- 1 July 2013
- journal article
- research article
- Published by Association for Computing Machinery (ACM) in ACM Transactions on Information Systems
- Vol. 31 (3) , 1-43
Abstract
Although Web search engines still answer user queries with lists of ten blue links to webpages, people are increasingly issuing queries to accomplish their daily tasks (e.g., finding a recipe , booking a flight , reading online news , etc.). In this work, we propose a two-step methodology for discovering tasks that users try to perform through search engines. First, we identify user tasks from individual user sessions stored in search engine query logs. In our vision, a user task is a set of possibly noncontiguous queries (within a user search session), which refer to the same need. Second, we discover collective tasks by aggregating similar user tasks, possibly performed by distinct users. To discover user tasks, we propose query similarity functions based on unsupervised and supervised learning approaches. We present a set of query clustering methods that exploit these functions in order to detect user tasks. All the proposed solutions were evaluated on a manually-built ground truth, and two of them performed better than state-of-the-art approaches. To detect collective tasks, we propose four methods that cluster previously discovered user tasks, which in turn are represented by the bag-of-words extracted from their composing queries. These solutions were also evaluated on another manually-built ground truth.Keywords
Funding Information
- European Commission
- Ministero dell'Istruzione, dell'Università e della Ricerca
- Seventh Framework Programme
This publication has 37 references indexed in Scilit:
- Mining Query Logs: Turning Search Usage Data into KnowledgeFoundations and Trends® in Information Retrieval, 2009
- A survey on session detection methods in query logs and a proposal for future evaluationInformation Sciences, 2009
- Learning about the world through long-term query logsACM Transactions on the Web, 2008
- Application of automatic topic identification on Excite Web search engine data logsInformation Processing & Management, 2005
- A taxonomy of web searchACM SIGIR Forum, 2002
- Query clustering using user logsACM Transactions on Information Systems, 2002
- Analysis of a very large web search engine query logACM SIGIR Forum, 1999
- Real life information retrieval: a study of user queries on the WebACM SIGIR Forum, 1998
- Development and application of a metric on semantic netsIEEE Transactions on Systems, Man, and Cybernetics, 1989
- Algorithm 447: efficient algorithms for graph manipulationCommunications of the ACM, 1973