Construction of Power Fault Knowledge Graph Based on Deep Learning
Open Access
- 11 July 2022
- journal article
- research article
- Published by MDPI AG in Applied Sciences
- Vol. 12 (14) , 6993
Abstract
A knowledge graph can structure heterogeneous knowledge in the field of power faults, construct the correlation between different pieces of knowledge, and solve the diversification, complexity, and island of fault data. There are many kinds of entities in power fault defect text, the relationship between entities is complex, and the data are often mixed with noise. It is necessary to research how to effectively mine the target data and separate the salient knowledge from the noise. Moreover, the traditional entity and relationship extraction methods used in the construction of a power fault knowledge graph cannot fully understand the text semantics, and the response accuracy is low. The Log system usually contains all kinds of information related to faults and a log analysis helps us collect fault information and perform association analysis. Therefore, a Bidirectional Sliced GRU with Gated Attention mechanism (BiSGRU-GA) model is proposed to detect the anomalous logs in the power system, this enriches the fault knowledge base and provides a good data resource for the construction of the knowledge graph. A new Bidirectional GRU with Gated Attention mechanism and Conditional Random Fields and a BERT input layer (BBiGRU-GA-CRF) model is proposed by introducing a BERT layer and Attention Mechanism into the Bidirectional GRU (BiGRU) model to more fully understand the context information of fault sentences and improve the accuracy of entity recognition of fault sentences. Aiming to solve the problems of large calculation cost and propagation error which occur in the traditional relationship extraction model, an improved Bidirectional Gated Recurrent Unit neural network with fewer parameters and the Gated Attention Mechanism (BiGRU-GA) model is proposed. This new model introduces an improved Gated Attention Mechanism to achieve better effects in relationship extraction. Compared with Bidirectional Long Short-Term Memory with Attention Mechanism (BiLSTM-Attention), the accuracy, recall, and F-measure of the model were improved by 1.79%, 13.83%, and 0.30% respectively, and the time cost is reduced by about 16%. The experimental results show that the BiGRU-GA model can capture local features, reduce the training time cost, and improve the model recognition effect.Keywords
Funding Information
- China’s national key R&D plan (2017YFC0806200)
- research and application demonstration of key technologies of integrated emergency communication based on radio and television system (2017YFC0806200)
This publication has 23 references indexed in Scilit:
- Deep learning in electrical utility industry: A comprehensive review of a decade of researchEngineering Applications of Artificial Intelligence, 2020
- Not All Attention Is Needed: Gated Attention Network for Sequence DataProceedings of the AAAI Conference on Artificial Intelligence, 2020
- Deep learning methods and applications for electrical power systems: A comprehensive reviewInternational Journal of Energy Research, 2020
- Recent advances in deep learningInternational Journal of Machine Learning and Cybernetics, 2020
- Experience Report: System Log Analysis for Anomaly Detection2016
- An Analytic Model for Fault Diagnosis in Power Systems Utilizing Redundancy and Temporal Information of Alarm MessagesIEEE Transactions on Power Systems, 2016
- An expert system for fault diagnosis in internal combustion engines using wavelet packet transform and neural networkExpert Systems with Applications, 2009
- On-line fault section estimation in power systems with radial basis function neural networkInternational Journal of Electrical Power & Energy Systems, 2002
- A fault diagnosis expert system for distribution substationsIEEE Transactions on Power Delivery, 2000
- A new neural networks approach to on-line fault section estimation using information of protective relays and circuit breakersIEEE Transactions on Power Delivery, 1994