Self-Organizing Maps for Topic Trend Discovery
Authors:
- 3 May 2010
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Signal Processing Letters
- Vol. 17 (6) , 607-610
Abstract
The large volume of data on the Internet makes it extremely difficult to extract high-level information, such as recurring or time-varying trends in document content. Dimensionality reduction techniques can be applied to simplify the analysis process but the amount of data is still quite large. If the analysis is restricted to just text documents then Latent Dirichlet Allocation (LDA) can be used to quantify semantic, or topical, groupings in the data set. This paper proposes a method that combines LDA with the visualization capabilities of Self-Organizing Maps to track topic trends over time. By examining the response of a map over time, it is possible to build a detailed picture of how the contents of a dataset change.Keywords
This publication has 8 references indexed in Scilit:
- Introduction to Information Retrieval2008
- Mining massive document collections by the WEBSOM methodInformation Sciences, 2004
- Finding scientific topicsProceedings of the National Academy of Sciences of the United States of America, 2004
- ProbMap – A probabilistic approach for mapping large document collectionsIntelligent Data Analysis: An International Journal, 2000
- 10.1162/jmlr.2003.3.4-5.993Applied Physics Letters, 2000
- Probabilistic latent semantic indexing1999
- Self-Organizing Maps1995
- Divergence measures based on the Shannon entropyIEEE Transactions on Information Theory, 1991