Performance of LDA and DCT models
- 24 February 2014
- journal article
- research article
- Published by SAGE Publications in Journal of Information Science
- Vol. 40 (3) , 281-292
Abstract
The Doubly Correlated Topic Model is a generative probabilistic topic model for automatically identifying topics from the corpus of the text documents. It is a mixed membership model, based on the fact that a document exhibits a number of topics. We used word co-occurrence statistical information for identifying an initial set of topics as posterior information for the model. Posterior inference methods utilized by the existing models are intractable and therefore provide an approximate solution. Consideration of co-occurred words as initial topics provides a tighter bound on the topic coherence. The proposed model is motivated by the Latent Dirichlet Allocation Model. The Doubly Correlated Topic Model differs from the Latent Dirichlet Allocation Model in its posterior inference; it uses the highest ranked co-occurred words as initial topics rather than obtaining from Dirichlet priors. The results of the proposed model suggest some improved performance on entropy and topical coherence over different datasets.Keywords
This publication has 12 references indexed in Scilit:
- Plink-LDA: Using Link as Prior Information in Topic Modeling2012
- Feature LDA: A Supervised Topic Model for Automatic Detection of Web API Documentations from the Web2012
- Statistical topic models for multi-label document classificationMachine Learning, 2011
- Hierarchical relational models for document networksThe Annals of Applied Statistics, 2010
- Adapting LDA Model to Discover Author-Topic Relations for Email Analysis2008
- A correlated topic model of ScienceThe Annals of Applied Statistics, 2007
- Finding scientific topicsProceedings of the National Academy of Sciences, 2004
- An Introduction to Variational Methods for Graphical ModelsMachine Learning, 1999
- Logistic-Normal Distributions: Some Properties and UsesBiometrika, 1980
- Maximum Likelihood from Incomplete Data Via the EM AlgorithmJournal of the Royal Statistical Society Series B: Statistical Methodology, 1977