Sogou-QCL
Authors:
Open Access
- 27 June 2018
- conference paper
- Published by Association for Computing Machinery (ACM)
- p. 1117-1120
Abstract
Data is of vital importance in the development of machine learning technologies. Recently, within the information retrieval field, a number of neural ranking frameworks have been proposed to address the ad-hoc search. These models usually need a large amount of query-document relevance judgments for training. However, obtaining this kind of relevance judgments needs a lot of money and manual effort. To shed light on this problem, researchers seek to use implicit feedback from users of search engines to improve the ranking performance. In this paper, we present a new dataset, Sogou-QCL, which contains 537,366 queries and five kinds of weak relevance labels for over 12 million query-document pairs. We apply Sogou-QCL dataset to train recent neural ranking models and show its potential to serve as weak supervision for ranking. We believe that Sogou-QCL will have a broad impact on corresponding areas.Keywords
Funding Information
- Natural Science Foundation of China (61622208, 61732008)
- National Key Basic Research Program (2015CB358700)
This publication has 12 references indexed in Scilit:
- Neural Ranking Models with Weak Supervision2017
- End-to-End Neural Ad-hoc Ranking with Kernel Pooling2017
- A Deep Relevance Matching Model for Ad-hoc Retrieval2016
- Incorporating Non-sequential Behavior into Click Models2015
- Log-based personalization2014
- User-click modeling for understanding and predicting search-behavior2011
- Temporal click model for sponsored search2010
- A dynamic bayesian network click model for web search ranking2009
- A user browsing model to predict search engine click data from past observations.2008
- A picture of search2006