Named Entity Recognition for Long COVID Biomedical Literature by Using Bert-BiLSTM-IDCNN-ATT-CRF Approach
Open Access
- 20 October 2023
- conference paper
- Published by Association for Computing Machinery (ACM)
- p. 1200-1205
Abstract
In recent years, with the exploration of pathological mechanisms and treatments of Long COVID, there has been a dramatic increase in related scientific publications. Effective extraction of key information from these texts is of great importance for public health and research progress. In the Long COVID context, Named Entity Recognition (NER) can be used to identify disease names as well as symptoms, which can help to analyze the sequelae caused by COVID-19 and its relationship with other diseases. Distinguished from molecular biomedical text mining, which focuses on the identification of entities such as genes, proteins, and chemistries and their relationships, Long COVID text mining faces problems such as the lack of publicly labeled datasets and the heavy workload of manual annotation. Moreover, due to the strong domain characteristics of Long COVID relevant named entities, models and methods that have achieved great performance in the generic domain will have significantly degraded named entity recognition performance on this domain. Based on the above problems, we constructed a Long COVID literature abstract NER dataset (LNER) and proposed a Long COVID biomedical literature NER model Bert-BiLSTM-IDCNN-ATT-CRF (BBIAC). First, the BERT-BiLSTM-CRF model is constructed on the LNER dataset. Then, the inflated convolutional neural network (IDCNN) is added between the BiLSTM and the CRF layers to obtain the local features in the text sequences. Finally, feature enhancement is performed by fusing the features of global and local information using the attention mechanism. The experimental results show that the method proposed in this paper for Long COVID literature can accurately extract the characteristic information of Long COVID symptoms and diseases, and has better performance compared to other baseline models.Keywords
This publication has 10 references indexed in Scilit:
- Long COVID: a review and proposed visualization of the complexity of long COVIDFrontiers in Immunology, 2023
- Long COVID: major findings, mechanisms and recommendationsNature Reviews Microbiology, 2023
- Chinese Named Entity Recognition of Epidemiological Investigation of Information on COVID-19 Based on BERTIEEE Access, 2022
- Multi-level semantic fusion network for Chinese medical named entity recognitionJournal of Biomedical Informatics, 2022
- Chinese clinical named entity recognition via multi-head self-attention based BiLSTM-CRFArtificial Intelligence in Medicine, 2022
- Named entity recognition in material field based on Bert-BILSTM-Attention-CRF2021
- COVID-19 outbreak: Migration, effects on society, global environment and preventionScience of The Total Environment, 2020
- BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding2019
- Long short-term memory RNN for biomedical named entity recognitionBMC Bioinformatics, 2017
- GENIA corpus—a semantically annotated corpus for bio-textminingBioinformatics, 2003