Latent semantic analysis for question classification with neural networks
Authors:
- 1 December 2011
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 437-442
Abstract
An important component of question answering systems is question classification. The task of question classification is to predict the entity type of the answer of a natural language question. Question classification is typically done using machine learning techniques. Most approaches use features based on word unigrams which leads to large feature space. In this work we applied Latent Semantic Analysis (LSA) technique to reduce the large feature space of questions to a much smaller and efficient feature space. We used two different classifiers: Back-Propagation Neural Networks (BPNN) and Support Vector Machines (SVM). We found that applying LSA on question classification can not only make the question classification more time efficient, but it also improves the classification accuracy by removing the redundant features. Furthermore, we discovered that when the original feature space is compact and efficient, its reduced space performs better than a large feature space with a rich set of features. In addition, we found that in the reduced feature space, BPNN performs better than SVMs which are widely used in question classification. Our result on the well known UIUC dataset is competitive with the state-of-the-art in this field, even though we used much smaller feature spaces.Keywords
This publication has 15 references indexed in Scilit:
- Question Classification by Weighted Combination of Lexical, Syntactic and Semantic Features2011
- From symbolic to sub-symbolic information in question classificationArtificial Intelligence Review, 2010
- Latent semantic analysis for text categorization using neural networkKnowledge-Based Systems, 2008
- Question classification with log-linear models2006
- Learning question classifiers: the role of semantic informationNatural Language Engineering, 2005
- Question classification using support vector machines2003
- Using LSI for text classification in the presence of background text2001
- Classification of Text DocumentsThe Computer Journal, 1998
- Indexing by latent semantic analysisJournal of the American Society for Information Science, 1990
- Automatic sense disambiguation using machine readable dictionaries1986