ANeTCM: A Novel MRC Framework for Traditional Chinese Medicine Named Entity Recognition
Open Access
- 16 August 2024
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Access
- Vol. 12, 113235-113243
Abstract
Traditional Chinese medicine (TCM) named entity recognition for supporting downstream tasks is receiving increasing attention. However, mainstream named entity recognition models applied to the TCM domain are still affected by the following two challenges: lack of domain knowledge and imbalance between entity classes. Therefore, we propose ANeTCM, a model that enhances both domain knowledge and inter-entity balance. Specifically, we first use a large number of TCM medical case data to continuously pretrain Roberta and enhance its domain knowledge. Secondly, the sequence annotation is converted into a machine reading comprehension task, and gated linear units are incorporated to further enhance the model’s feature learning capability. Finally, the weights of the samples are adjusted using a normal distribution to address the imbalance of entity classes. We conducted extensive experiments on two TCM named entity recognition datasets and selected several competitive models. The experimental results show the effectiveness of our model.Keywords
This publication has 31 references indexed in Scilit:
- A Dynamic Optimization-Based Ensemble Learning Method for Traditional Chinese Medicine Named Entity RecognitionIEEE Access, 2023
- Multi-level semantic fusion network for Chinese medical named entity recognitionJournal of Biomedical Informatics, 2022
- Dependency syntax guided BERT-BiLSTM-GAM-CRF for Chinese NERExpert Systems with Applications, 2022
- A novel transfer learning model for traditional herbal medicine prescription generation from unstructured resources and knowledgeArtificial Intelligence in Medicine, 2022
- A Nested Named Entity Recognition Method for Traditional Chinese Medicine Records2021
- Lawformer: A pre-trained language model for Chinese legal long documentsAI Open, 2021
- Improving Distantly-Supervised Named Entity Recognition for Traditional Chinese Medicine Text via a Novel Back-Labeling ApproachIEEE Access, 2020
- A TCM Question and Answer System Based on Medical Records Knowledge Graph2020
- A systematic study of the class imbalance problem in convolutional neural networksNeural Networks, 2018
- Named Entity Recognition for Highly Inflectional Languages: Effects of Various Lemmatization and Stemming Approaches2014