Pre-Training to Identify Immunization-Related Entities from Systematic Reviews
Open Access
- 15 December 2023
- conference paper
- Published by Association for Computing Machinery (ACM)
- p. 234-239
Abstract
Entity recognition from semi or unstructured systematic reviews is one of the most essential processes for evidence-based decision-making systems. The task involves collecting information from diverse studies concerning PICO (Population, Intervention, Comparison, and Outcomes) elements with additional domain-related information using named entity recognition (NER) as it is the fundamental task for extracting the structured data. In this study, we create an adapted immunization-related dataset and evaluate its performance in the extraction of relevant entities from systematic reviews. We conducted experiments to investigate several models for entity recognition performance using language models pre-trained in the biomedical domain. Our results suggest that PubMedBERT and BertNER results are superior to the other models, and the immunization-related entities can be successfully recognized with a 76% F1 score and 92% accuracy.Keywords
Funding Information
- GHPP: Global Health Protection Programme, Germany Federal Ministry of Health (BMG) (ZMI5-2523GHP027)
This publication has 13 references indexed in Scilit:
- Use of existing systematic reviews for the development of evidence-based vaccination recommendations: Guidance from the SYSVAC expert panelVaccine, 2023
- Application of natural language processing algorithms for extracting information from news articles in event-based surveillanceCanada Communicable Disease Report, 2020
- A Survey on Deep Learning for Named Entity RecognitionIEEE Transactions on Knowledge and Data Engineering, 2020
- BioBERT: a pre-trained biomedical language representation model for biomedical text miningBioinformatics, 2019
- Transfer Learning in Biomedical Natural Language Processing: An Evaluation of BERT and ELMo on Ten Benchmarking Datasets2019
- Publicly Available Clinical2019
- PICO Element Detection in Medical Text via Long Short-Term Memory Neural Networks2018
- Deep Contextualized Word Representations2018
- Neural Architectures for Named Entity Recognition2016
- Aligning Books and Movies: Towards Story-Like Visual Explanations by Watching Movies and Reading Books2015