An RG-FLAT-CRF Model for Named Entity Recognition of Chinese Electronic Clinical Records
Open Access
- 18 April 2022
- journal article
- research article
- Published by MDPI AG in Electronics
- Vol. 11 (8) , 1282
Abstract
The goal of Clinical Named Entity Recognition (CNER) is to identify clinical terms from medical records, which is of great importance for subsequent clinical research. Most of the current Chinese CNER models use a single set of features that do not consider the linguistic characteristics of the Chinese language, e.g., they do not use both word and character features, and they lack morphological information and specialized lexical information on Chinese characters in the medical field. We propose a RoBerta Glyce-Flat Lattice Transformer-CRF (RG-FLAT-CRF) model to address this problem. The model uses a convolutional neural network to discern the morphological information hidden in Chinese characters, and a pre-trained model to obtain vectors with medical features. The different vectors are stitched together to form a multi-feature vector. To use lexical information and avoid the problem of word separation errors, the model uses a lattice structure to add lexical information associated with each word, which can be used to avoid the problem of word separation errors. The RG-FLAT-CRF model scored 95.61%, 85.17%, and 91.2% for F1 on the CCKS 2017, 2019, and 2020 datasets, respectively. We used statistical tests to compare with other models. The results show that most p-values less than 0.05 are statistically significant.Keywords
Funding Information
- National Key R&D Program (Demonstration of R&D and Application of Integrated Science and Technology Service Platform for Central Plains Urban Agglomeration) (2018YFB1404500)
This publication has 34 references indexed in Scilit:
- Radical and Stroke-Enhanced Chinese Word Embeddings Based on Neural NetworksNeural Processing Letters, 2020
- Performance Comparison and Current Challenges of Using Machine Learning Techniques in CybersecurityEnergies, 2020
- A Survey on Deep Learning for Named Entity RecognitionIEEE Transactions on Knowledge and Data Engineering, 2020
- Chinese clinical named entity recognition with radical-level feature and self-attention mechanismJournal of Biomedical Informatics, 2019
- Incorporating dictionaries into deep neural networks for the Chinese clinical named entity recognitionJournal of Biomedical Informatics, 2019
- A multitask bi-directional RNN model for named entity recognition on Chinese electronic medical recordsBMC Bioinformatics, 2018
- The role of fine-grained annotations in supervised recognition of risk factors for heart disease from EHRsJournal of Biomedical Informatics, 2015
- Recognizing clinical entities in hospital discharge summaries using Structural Support Vector Machines with word representation featuresBMC Medical Informatics and Decision Making, 2013
- A General Natural-language Text Processor for Clinical RadiologyJournal of the American Medical Informatics Association, 1994
- Backpropagation Applied to Handwritten Zip Code RecognitionNeural Computation, 1989