Medical Named Entity Recognition Fusing Part-of-Speech and Stroke Features
Open Access
- 2 August 2023
- journal article
- research article
- Published by MDPI AG in Applied Sciences
- Vol. 13 (15) , 8913
Abstract
It is highly significant from a research standpoint and a valuable practice to identify diseases, symptoms, drugs, examinations, and other medical entities in medical text data to support knowledge maps, question and answer systems, and other downstream tasks that can provide the public with knowledgeable answers. However, when contrasted with other languages like English, Chinese words lack a distinct dividing line, and medical entities have problems such as long length and multiple entity types nesting. Therefore, to address these issues, this study suggests a medical named entity recognition (NER) approach that combines part-of-speech and stroke features. First, the text is fed into the BERT pre-training model to get the semantic representation of the text, while the part-of-speech feature vector is obtained using the part-of-speech dictionary, and the stroke feature of the text is extracted through a convolution neural network (CNN). The word vector is then joined with the part-of-speech and stroke feature vectors, respectively, and input into the BiLSTM and CRF layer for training. Additionally, to balance the disparity in data volume across several types of entities, the class-weighted loss function is included in the loss function. According to the experimental findings, our model’s F1 score on the CCKS2019 dataset reaches 78.65%, and the recognition performance exceeds many existing algorithms.Keywords
Funding Information
- Natural Science Foundation of Hunan Province (2021JJ30456, 2021JJ30734, ICT2022B60, 2021-KJWPDL-17, 61972055)
- State Key Laboratory of Industrial Control Technology (2021JJ30456, 2021JJ30734, ICT2022B60, 2021-KJWPDL-17, 61972055)
- national defense science and technology key laboratory fund project (2021JJ30456, 2021JJ30734, ICT2022B60, 2021-KJWPDL-17, 61972055)
- National Natural Science Foundation of China (2021JJ30456, 2021JJ30734, ICT2022B60, 2021-KJWPDL-17, 61972055)
This publication has 31 references indexed in Scilit:
- Cross-type biomedical named entity recognition with deep multi-task learningBioinformatics, 2018
- Combining rule-based and statistical mechanisms for low-resource named entity recognitionMachine Translation, 2017
- GRAM-CNN: a deep learning approach with local context for named entity recognition in biomedical textBioinformatics, 2017
- An attention-based BiLSTM-CRF approach to document-level chemical named entity recognitionBioinformatics, 2017
- Multi-channel BiLSTM-CRF Model for Emerging Named Entity Recognition in Social Media2017
- Fast and Accurate Entity Recognition with Iterated Dilated Convolutions2017
- Support Vector Machine2016
- Biomedical Named Entity Recognition based on Deep Neutral NetworkInternational Journal of Hybrid Information Technology, 2015
- Named Entity Recognition using Hidden Markov Model (HMM)International Journal on Natural Language Computing, 2012
- A Multilingual Named Entity Recognition System Using Boosting and C4.5 Decision Tree Learning Algorithms2006