Semi-automated title-abstract screening using natural language processing and machine learning
Authors:
Open Access
- 1 November 2024
- journal article
- research article
- Published by Springer Nature in Systematic Reviews
- Vol. 13 (1) , 1-14
Abstract
Background: Title-abstract screening in the preparation of a systematic review is a time-consuming task. Modern techniques of natural language processing and machine learning might allow partly automatization of title-abstract screening. In particular, clear guidance on how to proceed with these techniques in practice is of high relevance. Methods: This paper presents an entire pipeline how to use natural language processing techniques to make the titles and abstracts usable for machine learning and how to apply machine learning algorithms to adequately predict whether or not a publication should be forwarded to full text screening. Guidance for the practical use of the methodology is given. Results: The appealing performance of the approach is demonstrated by means of two real-world systematic reviews with meta analysis. Conclusions: Natural language processing and machine learning can help to semi-automatize title-abstract screening. Different project-specific considerations have to be made for applying them in practice.Keywords
Funding Information
- Bundesministerium für Forschung, Technologie und Raumfahrt (01KG2106)
- Fraunhofer-Institut für Techno- und Wirtschaftsmathematik ITWM
This publication has 43 references indexed in Scilit:
- Zero-Shot Generative Large Language Models for Systematic Review Screening Automation2024
- In‐depth evaluation of machine learning methods for semi‐automating article screening in a systematic review of mechanistic literatureResearch Synthesis Methods, 2022
- Using artificial intelligence methods for systematic review in health sciences: A systematic reviewResearch Synthesis Methods, 2022
- Machine learning for identifying relevant publications in updates of systematic reviews of diagnostic test studiesResearch Synthesis Methods, 2021
- An open source machine learning framework for efficient and transparent systematic reviewsNature Machine Intelligence, 2021
- Using systematic reviews in guideline development: The GRADE approachResearch Synthesis Methods, 2018
- Prioritising references for systematic reviews with RobotAnalyst: A user studyResearch Synthesis Methods, 2018
- Machine learning for identifying Randomized Controlled Trials: An evaluation and practitioner's guideResearch Synthesis Methods, 2018
- The Elements of Statistical Learning2009
- Random ForestsMachine Learning, 2001