Two-dimensional correlated topic models
Authors:
- 1 March 2016
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- Vol. 25, 2559-2563
Abstract
Latent Dirichlet allocation (LDA) is a widely-used topic model where a set of hidden topics is learned to model a collection of data in the form of bag-of-words. Correlated topic model (CTM) extends LDA, modelling topic correlation by using logistic normal prior for topic proportion vectors, instead of Dirichlet prior. However, in the case of bag-of-words from multiple data sources (for instance, streams of time-stamped measurements in sensor networks), where each word in a document is labeled with one of data sources from which the data comes, it is desirable to consider correlations across topics as well as across data sources. In this paper we present two-dimensional correlated topic model (2D-CTM) where we use a matrix-variate logistic normal distribution for a topic proportion matrix, in which correlations across topics as well as across data sources are captured by two covariance matrices of the matrix-variate normal distribution. We develop a mean-field variational inference algorithm for approximate posterior inference in our model 2D-CTM. We apply 2D-CTM to the problem of human activity recognition and sport tactic analysis, using data collected on multiple on-body sensors, with comparison to existing topic models.Keywords
This publication has 9 references indexed in Scilit:
- Discovery of activity composites using topic models: An analysis of unsupervised methodsPervasive and Mobile Computing, 2014
- The Opportunity challenge: A benchmark database for on-body sensor-based activity recognitionPattern Recognition Letters, 2013
- The DEBS 2013 grand challenge2013
- Sparse estimation of a covariance matrixBiometrika, 2011
- A Two-Dimensional Topic-Aspect Model for Discovering Multi-Faceted TopicsProceedings of the AAAI Conference on Artificial Intelligence, 2010
- Multi-field Correlated Topic Modeling2009
- Two-Dimensional Canonical Correlation AnalysisIEEE Signal Processing Letters, 2007
- Pachinko allocation2006
- Bayesian parameter estimation via variational methodsStatistics and Computing, 2000