SciMine: An Efficient Systematic Prioritization Model Based on Richer Semantic Information
Open Access
- 18 July 2023
- conference paper
- Published by Association for Computing Machinery (ACM)
- p. 205-215
Abstract
Systematic review is a crucial method that has been widely used. by scholars from different research domains. However, screening for relevant scientific literature from paper candidates remains an extremely time-consuming process so the task of screening prioritization has been established to reduce the human workload. Various methods under the human-in-the-loop fashion are proposed to solve this task by using lexical features. These methods, even though achieving better performance than more sophisticated feature-based models such as BERT, omit rich and essential semantic information, therefore suffered from feature bias. In this study, we propose a novel framework SciMine to accelerate this screening process by capturing semantic feature representations from both background and the corpus. In particular, based on contextual representation learned from the pre-trained language models, our approach utilizes an autoencoder-based classifier and a feature-dependent classification module to extract general document-level and phrase-level information. Then a ranking ensemble strategy is used to combine these two complementary pieces of information. Experiments on five real-world datasets demonstrate that SciMine achieves state-of-the-art performance and comprehensive analysis further shows the efficacy of SciMine to solve feature bias.Keywords
This publication has 35 references indexed in Scilit:
- Seed-driven Document Ranking for Systematic Reviews in Evidence-Based Medicine2018
- Finding better active learners for faster literature reviewsEmpirical Software Engineering, 2018
- Automated Phrase Mining from Massive Text CorporaIEEE Transactions on Knowledge and Data Engineering, 2018
- Automatic and Semi-Automatic Document Selection for Technology-Assisted Review2017
- Scalability of Continuous Active Learning for Reliable High-Recall Text Classification2016
- Mining Quality Phrases from Massive Text Corpora2015
- ClusCite2014
- Deploying an interactive machine learning system in an evidence-based practice center2012
- Fast unfolding of communities in large networksJournal of Statistical Mechanics: Theory and Experiment, 2008
- Reducing Workload in Systematic Review Preparation Using Automated Citation ClassificationJournal of the American Medical Informatics Association, 2006