Named Entity Recognition for Equipment Fault Diagnosis Based on RoBERTa-wwm-ext and Deep Learning Integration
Open Access
- 5 October 2024
- journal article
- research article
- Published by MDPI AG in Electronics
- Vol. 13 (19) , 3935
Abstract
Equipment fault diagnosis NER is to extract specific entities from Chinese equipment fault diagnosis text, which is the premise of constructing an equipment fault diagnosis knowledge graph. Named entity recognition for equipment fault diagnosis can also provide important data support for equipment maintenance support. Equipment fault diagnosis text has complex semantics, fuzzy entity boundaries, and limited data size. In order to extract entities from the equipment fault diagnosis text, this paper presents an NER model for equipment fault diagnosis based on RoBERTa-wwm-ext and Deep Learning network integration. Firstly, this model uses the RoBERTa-wwm-ext to extract context-sensitive embeddings of text sequences. Secondly, the context feature information is obtained through the BiLSTM network. Thirdly, the CRF is combined to output the label sequence with a constraint relationship, improve the accuracy of sequence labeling task, and complete the entity recognition task. Finally, experiments and predictions are carried out on the constructed dataset. The results show that the model can effectively identify five types of equipment fault diagnosis entities and has higher evaluation indexes than the traditional model. Its precision, recall, and F1 value are 94.57%, 95.39%, and 94.98%, respectively. The case study proves that the model can accurately recognize the entity of the input text.Keywords
Funding Information
- National Social Science Fund of China (2022-SKJJ-C-037)
This publication has 26 references indexed in Scilit:
- Thermal Fault Detection of High-Voltage Isolating Switches based on Hybrid Data and BERTArabian Journal for Science and Engineering, 2023
- Ensemble latent assimilation with deep learning surrogate model: application to drop interaction in a microfluidics deviceLab on a Chip, 2022
- Chinese mineral named entity recognition based on BERT modelExpert Systems with Applications, 2022
- Chinese clinical named entity recognition via multi-head self-attention based BiLSTM-CRFArtificial Intelligence in Medicine, 2022
- Dependency syntax guided BERT-BiLSTM-GAM-CRF for Chinese NERExpert Systems with Applications, 2022
- Entity Extraction of Electrical Equipment Malfunction Text by a Hybrid Natural Language Processing AlgorithmIEEE Access, 2021
- Application of LSTM for short term fog forecasting based on meteorological elementsNeurocomputing, 2020
- A parallel computing-based Deep Attention model for named entity recognitionThe Journal of Supercomputing, 2019
- Information extraction and knowledge graph construction from geoscience literatureComputers & Geosciences, 2018
- A dictionary to identify small molecules and drugs in free textBioinformatics, 2009