Powered Hawkes-Dirichlet Process: Challenging Textual Clustering using a Flexible Temporal Prior
Authors:
- 1 December 2021
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 509-518
Abstract
The textual content of a document and its publication date are intertwined. For example, the publication of a news article on a topic is influenced by previous publications on similar issues, according to underlying temporal dynamics. However, it can be challenging to retrieve meaningful information when textual information conveys little information or when temporal dynamics are hard to unveil. Furthermore, the textual content of a document is not always linked to its temporal dynamics. We develop a flexible method to create clusters of textual documents according to both their content and publication time, the Powered Dirichlet-Hawkes process (PDHP). We show PDHP yields significantly better results than state-of-the-art models when temporal information or textual content is weakly informative. The PDHP also alleviates the hypothesis that textual content and temporal dynamics are always perfectly correlated. PDHP allows retrieving textual clusters, temporal clusters, or a mixture of both with high accuracy when they are not. We demonstrate that PDHP generalizes previous work –such as the Dirichlet-Hawkes process (DHP) and Uniform process (UP). Finally, we illustrate the changes induced by PDHP over DHP and UP in a real-world application using Reddit data.Keywords
All Related Versions
This publication has 13 references indexed in Scilit:
- Complaint Classification using Word2Vec ModelInternational Journal of Engineering & Technology, 2018
- Model-based Clustering of Short Text Streams2018
- Bursty Human Dynamics2018
- An Influence-Receptivity Model for Topic Based Information Cascades2017
- Modeling the Dynamics of Learning Activity on the Web2017
- Dirichlet-Hawkes Processes with Applications to Clustering Continuous-Time Document Streams2015
- Clash of the Contagions: Cooperation and Competition in Information Diffusion2012
- Dynamic Non-Parametric Mixture Models and The Recurrent Chinese Restaurant Process: with Applications to Evolutionary Clustering2008
- Topics over time2006
- Dynamic topic models2006