Model‐based clustering of time‐dependent categorical sequences with application to the analysis of major life event patterns
- 8 March 2021
- journal article
- research article
- Published by Wiley in Statistical Analysis and Data Mining: An ASA Data Science Journal
- Vol. 14 (3) , 230-240
Abstract
Clustering categorical sequences is a problem that arises in many fields. There is a few techniques available in this framework but none of them take into account the possible temporal character of transitions from one state to another. A mixture of Markov models is proposed, where transition probabilities are represented as functions of time. The corresponding expectation–maximization algorithm is discussed along with related computational challenges. The effectiveness of the proposed procedure is illustrated on the set of simulation studies, in which it outperforms four alternative approaches. The method is applied to major life event sequences from the British Household Panel Survey. As reflected by Bayesian Information Criterion, the proposed model demonstrates substantially better performance than its competitors. The analysis of obtained results and related transition probability plots reveals two groups of individuals: people with a conventional development of life course and those encountering some challenges.Keywords
This publication has 21 references indexed in Scilit:
- Finite mixture models and model-based clusteringStatistics Surveys, 2010
- Choosing starting values for the EM algorithm for getting the highest likelihood in multivariate Gaussian mixture modelsComputational Statistics & Data Analysis, 2003
- Computational and Inferential Difficulties with Mixture Posterior DistributionsJournal of the American Statistical Association, 2000
- Normalized cuts and image segmentationIEEE Transactions on Pattern Analysis and Machine Intelligence, 2000
- Hidden Markov Models in Computational BiologyJournal of Molecular Biology, 1994
- Clustering criteria for discrete data and latent class modelsJournal of Classification, 1991
- Comparing partitionsJournal of Classification, 1985
- Estimating the Dimension of a ModelThe Annals of Statistics, 1978
- On the theory and construction of k-clustersThe Computer Journal, 1972
- Hierarchical Grouping to Optimize an Objective FunctionJournal of the American Statistical Association, 1963