Modeling the Mutual Dynamic Correlations of Words in Written Texts Using Multivariate Hawkes Processes
Open Access
Abstract
The occurrence patterns of important words found in six texts (one historical pamphlet and five renowned academic books) are analyzed using both univariate and multivariate Hawkes processes. By treating the occurrence patterns as binary time-series data along the texts, we investigate how effectively univariate and multivariate Hawkes processes capture the characteristics of these word occurrence signals. Through maximum likelihood estimation and subsequent simulations, we found that the multivariate Hawkes process clearly outperforms the univariate Hawkes process in modeling word occurrence signals. Moreover, we found that the multivariate Hawkes process can provide a Hawkes graph, which serves as an intuitive representation of the relationships between concepts appearing in the analyzed text. Furthermore, our study demonstrates that the importance of concepts within a given text can be quantitatively estimated based on the optimized parameter values of the multivariate Hawkes process.Keywords
Funding Information
- JSPS KAKENHI (24K15198)
This publication has 37 references indexed in Scilit:
- Hawkes process modeling of COVID-19 with mobility leading indicators and spatial covariatesInternational Journal of Forecasting, 2022
- A stochastic model of word occurrences in hierarchically structured written textsSN Applied Sciences, 2022
- Simulation of pseudo-text synthesis for generating words with long-range dynamic correlationsSN Applied Sciences, 2020
- Multifractal correlations in natural language written texts: Effects of language family and long word statisticsPhysica A: Statistical Mechanics and its Applications, 2017
- On the origin of long-range correlations in textsProceedings of the National Academy of Sciences, 2012
- Modelling security market events in continuous time: Intensity based, multivariate point process modelsJournal of Econometrics, 2007
- Hierarchical structures induce long-range dynamical correlations in written textsProceedings of the National Academy of Sciences, 2006
- Seismicity Analysis through Point-process Modeling: A ReviewPure and Applied Geophysics, 1999
- Language in the Line vs. Language in the Mass: On the Efficiency of Sequential Modelling in the Analysis of RhythmJournal of Quantitative Linguistics, 1999
- Statistical Models for Earthquake Occurrences and Residual Analysis for Point ProcessesJournal of the American Statistical Association, 1988