Network-Based Bag-of-Words Model for Text Classification
Open Access
- 28 April 2020
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Access
- Vol. 8, 82641-82652
Abstract
The rapidly developing internet and other media have produced a tremendous amount of text data, making it a challenging and valuable task to find a more effective way to analyze text data by machine. Text representation is the first step for a machine to understand the text, and the commonly used text representation method is the Bag-of-Words (BoW) model. To form the vector representation of a document, the BoW model separately matches and counts each element in the document, neglecting much correlation information among words. In this paper, we propose a network-based bag-of-words model, which collects high-level structural and semantic meaning of the words. Because the structural and semantic information of a network reflects the relationship between nodes, the proposed model can distinguish the relation of words. We apply the proposed model to text classification and compare the performance of the proposed model with different text representation methods on four document datasets. The results show that the proposed method achieves the best performance with high efficiency. Using the Eccentricity property of the network as features can get the highest accuracy. We also investigate the influence of different network structures in the proposed method. Experimental results reveal that, for text classification, the dynamic network is more suitable than the static network and the hybrid network.Keywords
Funding Information
- Beijing Natural Science Foundation (8202039)
- National Basic Research Program of China (2017YFB1201105)
This publication has 30 references indexed in Scilit:
- Complex networks analysis of language complexityEurophysics Letters, 2012
- A complex network approach to text summarizationInformation Sciences, 2009
- Critical phenomena in complex networksReviews of Modern Physics, 2008
- Strong correlations between text quality and complex networks featuresPhysica A: Statistical Mechanics and its Applications, 2007
- The network of concepts in written textsThe European Physical Journal B, 2006
- Complex networks: Structure and dynamicsPhysics Reports, 2006
- A Survey of Eigenvector Methods for Web Information RetrievalSIAM Review, 2005
- Global organization of the Wordnet lexiconProceedings of the National Academy of Sciences, 2002
- The small world of human languageProceedings Of The Royal Society B-Biological Sciences, 2001
- Indexing by latent semantic analysisJournal of the American Society for Information Science, 1990