Knowledge-Graph- and GCN-Based Domain Chinese Long Text Classification Method
Open Access
- 6 July 2023
- journal article
- research article
- Published by MDPI AG in Applied Sciences
- Vol. 13 (13) , 7915
Abstract
In order to solve the current problems in domain long text classification tasks, namely, the long length of a document, which makes it difficult for the model to capture key information, and the lack of expert domain knowledge, which leads to insufficient classification accuracy, a domain long text classification model based on a knowledge graph and a graph convolutional neural network is proposed. BERT is used to encode the text, and each word’s corresponding vector is used as a node for the graph convolutional neural network so that the initialized vector contains rich semantic information. Using the trained entity–relationship extraction model, the entity-to-entity–relationships in the document are extracted and used as the edges of the graph convolutional neural network, together with syntactic dependency information. The graph structure mask is used to learn about edge relationships and edge types to further enhance the learning ability of the model for semantic dependencies between words. The method further improves the accuracy of domain long text classification by fusing knowledge features and data features. Experiments on three long text classification datasets—IFLYTEK, THUCNews, and the Chinese corpus of Fudan University—show accuracy improvements of 8.8%, 3.6%, and 2.6%, respectively, relative to the BERT model.Keywords
Funding Information
- National Natural Science Foundation of China (61902427)
This publication has 23 references indexed in Scilit:
- Knowledge-enabled BERT for aspect-based sentiment analysisKnowledge-Based Systems, 2021
- A Graph Convolutional Network‐Based Sensitive Information Detection AlgorithmComplexity, 2021
- Research on Automated Detection of Sensitive Information Based on BERTJournal of Physics: Conference Series, 2021
- Sensitive Information Detection Based on Convolution Neural Network and Bi-Directional LSTM2020
- Joint Aspect Extraction and Sentiment Analysis with Directional Graph Convolutional Networks2020
- Be More with Less: Hypergraph Attention Networks for Inductive Text Classification2020
- Every Document Owns Its Structure: Inductive Text Classification via Graph Neural Networks2020
- Domain-Adversarial Graph Neural Networks for Text Classification2019
- Detecting Sensitive Information of Unstructured Text Using Convolutional Neural Network2019
- Neural Attentive Bag-of-Entities Model for Text Classification2019