Text Classification Based on the Heterogeneous Graph Considering the Relationships between Documents
Open Access
- 13 December 2023
- journal article
- research article
- Published by MDPI AG in Big Data and Cognitive Computing
- Vol. 7 (4) , 181
Abstract
Text classification is the task of estimating the genre of a document based on information such as word co-occurrence and frequency of occurrence. Text classification has been studied by various approaches. In this study, we focused on text classification using graph structure data. Conventional graph-based methods express relationships between words and relationships between words and documents as weights between nodes. Then, a graph neural network is used for learning. However, there is a problem that conventional methods are not able to represent the relationship between documents on the graph. In this paper, we propose a graph structure that considers the relationships between documents. In the proposed method, the cosine similarity of document vectors is set as weights between document nodes. This completes a graph that considers the relationship between documents. The graph is then input into a graph convolutional neural network for training. Therefore, the aim of this study is to improve the text classification performance of conventional methods by using this graph that considers the relationships between document nodes. In this study, we conducted evaluation experiments using five different corpora of English documents. The results showed that the proposed method outperformed the performance of the conventional method by up to 1.19%, indicating that the use of relationships between documents is effective. In addition, the proposed method was shown to be particularly effective in classifying long documents.Keywords
This publication has 20 references indexed in Scilit:
- Deep Unordered Composition Rivals Syntactic Methods for Text Classification2015
- Improved Semantic Representations From Tree-Structured Long Short-Term Memory Networks2015
- A Convolutional Neural Network for Modelling Sentences2014
- Glove: Global Vectors for Word Representation2014
- Word co-occurrence features for text classificationInformation Systems, 2011
- Understanding bag-of-words model: a statistical frameworkInternational Journal of Machine Learning and Cybernetics, 2010
- The Graph Neural Network ModelIEEE Transactions on Neural Networks, 2008
- Long Short-Term MemoryNeural Computation, 1997
- Bagging predictorsMachine Learning, 1996
- Automatic Indexing: An Experimental InquiryJournal of the ACM, 1961