Incorporating Entity Correlation Knowledge into Topic Modeling
Authors:
- Qilin WangQWQilin Wang
- Dandan SongDSDandan Song
- Xiuquan LiXLXiuquan Li
- 1 August 2017
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 254-258
Abstract
Latent Dirichlet Allocation (LDA) is a popular topic modeling technique for exploring hidden topics in text corpora. Standard LDA model suffers the problem that the topic assignment of each word is independent and lacks the mechanism to utilize the rich prior background knowledge to learn semantically coherent topics. To address this problem, in this paper, we propose a model called Entity Correlation Latent Dirichlet Allocation (EC-LDA) by incorporating constraints derived from entity correlations as the prior knowledge into LDA topic model. Different from other knowledge-based topic models which extract the knowledge information directly from the train dataset itself or even from the human judgements, for our work, we take advantage of the prior knowledge from the external knowledge base (Freebase 1, in our experiment). Hence, our approach is more suitable to widely kinds of text corpora in different scenarios. We fit our proposed model using Gibbs sampling. Experiment results demonstrate the effectiveness of our model compared with standard LDA.Keywords
This publication has 9 references indexed in Scilit:
- Community Level Diffusion Extraction2015
- Efficient Methods for Incorporating Knowledge into Topic Models2015
- A semantic matching energy function for learning with multi-relational dataMachine Learning, 2013
- Incorporating domain knowledge into topic modeling via Dirichlet Forest priors2009
- Polylingual topic models2009
- Modeling hidden topics on document manifold2008
- BiTAM2006
- Finding scientific topicsProceedings of the National Academy of Sciences, 2004
- Probabilistic latent semantic indexing1999