Detecting Short-lasting Topics Using Nonnegative Tensor Decomposition
Preprint
Abstract
Temporal data (such as news articles or Twitter feeds) often consists of a mixture of long-lasting trends and popular but short-lasting topics of interest. A truly successful topic modeling strategy should be able to detect both types of topics and clearly locate them in time. In this paper, we compare the variability of topic lengths discovered by several well-known topic modeling methods including latent Dirichlet allocation (LDA), nonnegative matrix factorization (NMF), as well as its tensor counterparts based on the nonnegative CANDECOMP/PARAFAC tensor decomposition (NCPD and Online NCPD). We demonstrate that only tensor-based methods with the dedicated mode for tracking time evolution successfully detect short-lasting topics. Furthermore, these methods are considerably more accurate in discovering the points in time when topics appeared and disappeared compared to the matrix-based methods such as LDA and NMF. We propose quantitative ways to measure the topic length and demonstrate the ability of NCPD (as well as its online variant), to discover short and long-lasting temporal topics in semi-synthetic and real-world data including news headlines and COVID-19 related tweets.Keywords
All Related Versions
This publication has 19 references indexed in Scilit:
- On Large-Scale Dynamic Topic Modeling with Nonnegative CP Tensor Decomposition2021
- Exploring the Political Agenda of the European Parliament Using a Dynamic Topic Modeling ApproachPolitical Analysis, 2017
- Semi-supervised non-negative matrix factorization for image clustering with graph LaplacianMultimedia Tools and Applications, 2013
- Deciphering Signatures of Mutational Processes Operative in Human CancerCell Reports, 2013
- SVD based initialization: A head start for nonnegative matrix factorizationPattern Recognition, 2008
- Metagenes and molecular pattern discovery using matrix factorizationProceedings of the National Academy of Sciences, 2004
- Learning the parts of objects by non-negative matrix factorizationNature, 1999
- Source identification of bulk wet deposition in Finland by positive matrix factorizationAtmospheric Environment, 1995
- Positive matrix factorization: A non‐negative factor model with optimal utilization of error estimates of data valuesEnvironmetrics, 1994
- Analysis of Individual Differences in Multidimensional Scaling Via an N-way Generalization of “Eckart-Young” DecompositionPsychometrika, 1970