Artificial Neural Network for Document Classification Using Latent Semantic Indexing
Authors:
- Cheng Hua LiCLCheng Hua Li
- Soon Cheol ParkSPSoon Cheol Park
- 1 November 2007
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- Vol. 37, 17-21
Abstract
In this study, we construct document classification systems using artificial neural network training by the multi-output perceptron learning algorithm (MOPL) and back-propagation neural network (BPNN). Most classic classification systems represent the contents of documents with a set of index terms, which is termed the vector space model (VSM). However, this method requires a high dimensional space to represent the documents, and it does not take into account the semantic relationship between the terms, which could lead to a poor classification performance. In this paper, we introduce latent semantic indexing (LSI) in our systems. It could not only reduce the dimensionality to a great extent but also determine important associative relationships between the terms. The LSI also aids in accelerating the training speed and improves the classification accuracy. We test our classification systems on the standard Reuter-21578 collection. The experimental evaluations show that the system training with the LSI is considerably faster than the original system training with the VSM and that the former yields better classification results.Keywords
This publication has 9 references indexed in Scilit:
- Neighbor-weighted K-nearest neighbor for unbalanced text corpusExpert Systems with Applications, 2005
- Feature selection for text categorization on imbalanced dataACM SIGKDD Explorations Newsletter, 2004
- A multistrategy approach for digital text categorization from imbalanced documentsACM SIGKDD Explorations Newsletter, 2004
- Co-trained support vector machines for large scale unstructured document classification using unlabeled data and syntactic informationInformation Processing & Management, 2004
- Hierarchical Text Classification Methods and Their Specification2003
- Hierarchical Text Categorization Using Neural NetworksInformation Retrieval Journal, 2002
- Using Linear Algebra for Intelligent Information RetrievalSIAM Review, 1995
- Indexing by latent semantic analysisJournal of the American Society for Information Science, 1990
- An algorithm for suffix strippingProgram: electronic library and information systems, 1980