TripClick: The Log Files of a Large Health Web Search Engine
Authors:
Open Access
- 11 July 2021
- conference paper
- Published by Association for Computing Machinery (ACM)
- p. 2507-2513
Abstract
Click logs are valuable resources for a variety of information retrieval (IR) tasks. This includes query understanding/analysis, as well as learning effective IR models particularly when the models require large amounts of training data. We release a large-scale domain-specific dataset of click logs, obtained from user interactions of the Trip Database health web search engine. Our click log dataset comprises approximately 5.2 million user interactions collected between 2013 and 2020. We use this dataset to create a standard IR evaluation benchmark - TripClick - with around 700,000 unique free-text queries and 1.3 million pairs of query-document relevance signals, whose relevance is estimated by two click-through models. As such, the collection is one of the few datasets offering the necessary data richness and scale to train neural IR models with a large amount of parameters, and notably the first in the health domain. Using TripClick, we conduct experiments to evaluate a variety of IR models, showing the benefits of exploiting this data to train neural architectures. In particular, the evaluation results show that the best performing neural IR model significantly improves the performance by a large margin relative to classical IR models, especially for more frequent queries.Keywords
All Related Versions
Funding Information
- NSF (IIS-1956221)
This publication has 17 references indexed in Scilit:
- Anserini2017
- End-to-End Neural Ad-hoc Ranking with Kernel Pooling2017
- Log-based personalization2014
- Learning deep structured semantic models for web search using clickthrough data2013
- A comparative study of methods for estimating query language models with pseudo feedback2009
- The Probabilistic Relevance Framework: BM25 and BeyondFoundations and Trends® in Information Retrieval, 2009
- A picture of search2006
- Optimal search strategies for retrieving scientifically strong studies of treatment from Medline: analytical surveyBMJ, 2005
- Relevance based language models2001
- The seventh text REtrieval conference (TREC-7)1999