Beyond Probability Ranking Principle: Modeling the Dependencies among Documents
Authors:
Open Access
- 8 March 2021
- conference paper
- Published by Association for Computing Machinery (ACM)
- p. 1137-1140
Abstract
Probability Ranking Principle (PRP), which assumes that each document has a unique and independent probability to satisfy a particular information need, is one of the fundamental principles for ranking. Traditionally, heuristic ranking features and well-known learning-to-rank approaches have been designed by following the PRP principle. Recently, neural IR models, which adopt deep learning to enhance the ranking performances, also obey the PRP principle. Though it has been widely used for nearly five decades, in-depth analysis shows that PRP is not an optimal principle for ranking, due to its independent assumption that each document should be independent of the rest candidates. Counter examples include pseudo relevance feedback, interactive information retrieval, search result diversification, etc. To solve the problem, researchers recently proposed to model the dependencies among the documents during the designing of ranking models. A number of ranking models have been proposed and state-of-the-art ranking performances have been achieved. This tutorial aims to give a comprehensive survey on these recently developed ranking models that go beyond the PRP principle. The tutorial tries to categorize these models based on their intrinsic assumptions: assuming that the documents are independent, sequentially dependent, or globally dependent. In this way, we expect the researchers focusing on ranking in search and recommendation can have a novel angle of view on the designing of ranking models, and therefore can stimulate new ideas on developing novel ranking models. The material of this tutorial can be found in https://github.com/pl8787/wsdm2021-beyond-prp-tutorial.Keywords
Funding Information
- Beijing Academy of Artificial Intelligence (BAAI) (BAAI2020ZJ0303)
- National Natural Science Foundation of China (NSFC) (61906180)
- Tencent AI Lab Rhino-Bird Focused Research Program (JR202033)
This publication has 31 references indexed in Scilit:
- Information Retrieval as Card Playing2015
- Learning Maximal Marginal Relevance Model via Directly Optimizing Diversity Evaluation Measures2015
- Incorporating query-specific feedback into learning-to-rank models2014
- Learning deep structured semantic models for web search using clickthrough data2013
- Learning to Rank for Information RetrievalFoundations and Trends® in Information Retrieval, 2009
- Learning to rank2007
- Training linear SVMs in linear time2006
- Learning to rank using gradient descent2005
- The probabilistic character of relevanceInformation Processing & Management, 1977
- THE PROBABILITY RANKING PRINCIPLE IN IRJournal of Documentation, 1977