Supporting systematic reviews using LDA-based document representations
Open Access
- 26 November 2015
- journal article
- review article
- Published by Springer Nature in Systematic Reviews
- Vol. 4 (1) , 172
Abstract
Identifying relevant studies for inclusion in a systematic review (i.e. screening) is a complex, laborious and expensive task. Recently, a number of studies has shown that the use of machine learning and text mining methods to automatically identify relevant studies has the potential to drastically decrease the workload involved in the screening phase. The vast majority of these machine learning methods exploit the same underlying principle, i.e. a study is modelled as a bag-of-words (BOW). We explore the use of topic modelling methods to derive a more informative representation of studies. We apply Latent Dirichlet allocation (LDA), an unsupervised topic modelling approach, to automatically identify topics in a collection of studies. We then represent each study as a distribution of LDA topics. Additionally, we enrich topics derived using LDA with multi-word terms identified by using an automatic term recognition (ATR) tool. For evaluation purposes, we carry out automatic identification of relevant studies using support vector machine (SVM)-based classifiers that employ both our novel topic-based representation and the BOW representation. Our results show that the SVM classifier is able to identify a greater number of relevant studies when using the LDA representation than the BOW representation. These observations hold for two systematic reviews of the clinical domain and three reviews of the social science domain. A topic-based feature representation of documents outperforms the BOW representation when applied to the task of automatic citation screening. The proposed term-enriched topics are more informative and less ambiguous to systematic reviewers.Keywords
This publication has 31 references indexed in Scilit:
- A new iterative method to reduce workload in systematic review processInternational Journal of Computational Biology and Drug Design, 2013
- Screening nonrandomized studies for medical systematic reviews: A comparative study of classifiersArtificial Intelligence in Medicine, 2012
- Performance of support-vector-machine-based classification on 15 systematic review topics evaluated with the WSS@95 measure: Table 1Journal of the American Medical Informatics Association, 2011
- A new algorithm for reducing the workload of experts in performing systematic reviewsJournal of the American Medical Informatics Association, 2010
- Combining classifiers for robust PICO element detectionBMC Medical Informatics and Decision Making, 2010
- Semi-automated screening of biomedical citations for systematic reviewsBMC Bioinformatics, 2010
- Statistical Considerations in Meta-analysisInfectious Disease Clinics of North America, 2009
- Answering Clinical Questions with Knowledge-Based and Statistical TechniquesComputational Linguistics, 2007
- Biomedical Language Processing: What's Beyond PubMed?Molecular Cell, 2006
- Reducing Workload in Systematic Review Preparation Using Automated Citation ClassificationJournal of the American Medical Informatics Association, 2006