rHDP: An Aspect Sharing-Enhanced Hierarchical Topic Model for Multi-Domain Corpus
Open Access
- 29 December 2023
- journal article
- research article
- Published by Association for Computing Machinery (ACM) in ACM Transactions on Information Systems
- Vol. 42 (3) , 1-31
Abstract
Learning topic hierarchies from a multi-domain corpus is crucial in topic modeling as it reveals valuable structural information embedded within documents. Despite the extensive literature on hierarchical topic models, effectively discovering inter-topic correlations and differences among subtopics at the same level in the topic hierarchy, obtained from multiple domains, remains an unresolved challenge. This article proposes an enhanced nested Chinese restaurant process (nCRP), nCRP+, by introducing an additional mechanism based on Chinese restaurant franchise (CRF) for aspect-sharing pattern extraction in the original nCRP. Subsequently, by employing the distribution extracted from nCRP+ as the prior distribution for topic hierarchy in the hierarchical Dirichlet processes (HDP), we develop a hierarchical topic model for multi-domain corpus, named rHDP. We describe the model with the analogy of Chinese restaurant franchise based on the central kitchen and propose a hierarchical Gibbs sampling scheme to infer the model. Our method effectively constructs well-established topic hierarchies, accurately reflecting diverse parent-child topic relationships, explicit topic aspect sharing correlations for inter-topics, and differences between these shared topics. To validate the efficacy of our approach, we conduct experiments using a renowned public dataset and an online collection of Chinese financial documents. The experimental results confirm the superiority of our method over the state-of-the-art techniques in identifying multi-domain topic hierarchies, according to multiple evaluation metrics.Keywords
Funding Information
- National Natural Science Foundation of China (61972184, 62272205, 62272206, and 62076112)
- Natural Science and Foundation of Jiangxi Province (20212ACB202002 and 20192BAB207017)
- Funding Program for Academic and Technical Leaders in Major Disciplines of Jiangxi Province (20213BCJL22041)
- Research Project for Science and Technology of Jiangxi Education Department (GJJ2200643)
This publication has 42 references indexed in Scilit:
- Bayesian Nonparametric Relational Topic Model through Dependent Gamma ProcessesIEEE Transactions on Knowledge and Data Engineering, 2016
- Additive Regularization for Hierarchical Multimodal Topic ModelingMachine Learning and Data Analysis, 2016
- Discovering hierarchical topic evolution in time‐stamped documentsJournal of the Association for Information Science and Technology, 2015
- Nested Hierarchical Dirichlet ProcessesIEEE Transactions on Pattern Analysis and Machine Intelligence, 2014
- Modeling topic hierarchies with the recursive chinese restaurant process2012
- The nested chinese restaurant process and bayesian nonparametric inference of topic hierarchiesJournal of the ACM, 2010
- Hierarchical topic modeling with nested hierarchical Dirichlet processJournal of Zhejiang University-SCIENCE A, 2009
- The Nested Dirichlet ProcessJournal of the American Statistical Association, 2008
- Hierarchical Dirichlet ProcessesJournal of the American Statistical Association, 2006
- Pachinko allocation2006