Text Level Graph Neural Network for Text Classification
Preprint
Abstract
Recently, researches have explored the graph neural network (GNN) techniques on text classification, since GNN does well in handling complex structures and preserving global information. However, previous methods based on GNN are mainly faced with the practical problems of fixed corpus level graph structure which do not support online testing and high memory consumption. To tackle the problems, we propose a new GNN based model that builds graphs for each input text with global parameters sharing instead of a single graph for the whole corpus. This method removes the burden of dependence between an individual text and entire corpus which support online testing, but still preserve global information. Besides, we build graphs by much smaller windows in the text, which not only extract more local features but also significantly reduce the edge numbers as well as memory consumption. Experiments show that our model outperforms existing models on several text classification datasets even with consuming less memory.Keywords
All Related Versions
This publication has 4 references indexed in Scilit:
- Graph neural networks: A review of methods and applicationsAI Open, 2020
- Knowledge Transfer for Out-of-Knowledge-Base Entities : A Graph Neural Network Approach2017
- Understanding bag-of-words model: a statistical frameworkInternational Journal of Machine Learning and Cybernetics, 2010
- Backpropagation Applied to Handwritten Zip Code RecognitionNeural Computation, 1989