Large-scale latent semantic analysis
- 8 February 2011
- journal article
- Published by Springer Nature in Behavior Research Methods
- Vol. 43 (2) , 414-423
Abstract
Latent semantic analysis (LSA) is a statistical technique for representing word meaning that has been widely used for making semantic similarity judgments between words, sentences, and documents. In order to perform an LSA analysis, an LSA space is created in a two-stage procedure, involving the construction of a word frequency matrix and the dimensionality reduction of that matrix through singular value decomposition (SVD). This article presents LANSE, an SVD algorithm specifically designed for LSA, which allows extremely large matrices to be processed using off-the-shelf computer hardware.Keywords
This publication has 27 references indexed in Scilit:
- A probabilistic model for Latent Semantic IndexingJournal of the American Society for Information Science and Technology, 2005
- An introduction to latent semantic analysisDiscourse Processes, 1998
- Using latent semantic analysis to assess knowledge: Some technical considerationsDiscourse Processes, 1998
- Learning from text: Matching readers and texts by latent semantic analysisDiscourse Processes, 1998
- The measurement of textual coherence with latent semantic analysisDiscourse Processes, 1998
- A solution to Plato's problem: The latent semantic analysis theory of acquisition, induction, and representation of knowledge.Psychological Review, 1997
- Improving the retrieval of information from external sourcesBehavior Research Methods, Instruments, & Computers, 1991
- Indexing by latent semantic analysisJournal of the American Society for Information Science, 1990
- Computational Variants of the Lanczos Method for the EigenproblemIMA Journal of Applied Mathematics, 1972
- The Approximation of One Matrix by Another of Lower RankPsychometrika, 1936