You Can Teach an Old Dog New Tricks: Rank Fusion applied to Coordination Level Matching for Ranking in Systematic Reviews
Open Access
- 8 April 2020
- book chapter
- Published by Springer Nature
- Vol. 12035, 399-414
Abstract
Coordination level matching is a ranking method originally proposed to rank documents given Boolean queries that is now several decades old. Rank fusion is a relatively recent method for combining runs from multiple systems into a single ranking, and has been shown to significantly improve the ranking. This paper presents a novel extension to coordination level matching, by applying rank fusion to each sub-clause of a Boolean query. We show that, for the tasks of systematic review screening prioritisation and stopping estimation, our method significantly outperforms the state-of-the-art learning to rank and bag-of-words-based systems for this domain. Our fully automatic, unsupervised method has (i) the potential for significant real-world cost savings (ii) does not rely on any intervention from the user, and (iii) is significantly better at ranking documents given only a Boolean query in the context of systematic reviews when compared to other approaches.Keywords
This publication has 32 references indexed in Scilit:
- Query Performance Prediction Using Reference ListsACM Transactions on Information Systems, 2016
- RobotReviewer: evaluation of a system for automatically assessing bias in clinical trialsJournal of the American Medical Informatics Association, 2015
- Using text mining for study identification in systematic reviews: a systematic review of current approachesSystematic Reviews, 2015
- Systematic Reviewing2013
- Antinociceptive effect of geranylgeraniol and 6α,7β-dihydroxyvouacapan-17β-oate methyl ester isolated from Pterodon pubescens BenthBMC Pharmacology, 2010
- Reducing Workload in Systematic Review Preparation Using Automated Citation ClassificationJournal of the American Medical Informatics Association, 2006
- An exploration of axiomatic approaches to information retrieval2005
- Comparing Rank and Score Combination Methods for Data Fusion in Information RetrievalInformation Retrieval Journal, 2005
- A probabilistic approach to information retrieval in systems with boolean search request formulationsJournal of the American Society for Information Science, 1982
- A general model of query processing in information retrieval systemsInformation Processing & Management, 1981