A comparison of some criteria for states selection in the latent Markov model for longitudinal data
Preprint
Abstract
We compare different selection criteria to choose the number of latent states of a multivariate latent Markov model for longitudinal data. This model is based on an underlying Markov chain to represent the evolution of a latent characteristic of a group of individuals over time. Then, the response variables observed at the different occasions are assumed to be conditionally independent given this chain. Maximum likelihood of the model is carried out through an Expectation-Maximization algorithm based on forward-backward recursions which are well known in the hidden Markov literature for time series. The selection criteria we consider in our comparison are based on penalized versions of the maximum log-likelihood or on the posterior probabilities of belonging to each latent state, that is the conditional probability of the latent state given the observed data. A Monte Carlo simulation study shows that the indices referred to the log-likelihood based information criteria perform in general better with respect to those referred to the classification based criteria. This is due to the fact that the latter tend to underestimate the true number of latent states, especially in the univariate case.Keywords
All Related Versions
This publication has 16 references indexed in Scilit:
- Selecting hidden Markov model state number with cross-validated likelihoodComputational Statistics, 2007
- Deciding on the Number of Classes in Latent Class Analysis and Growth Mixture Modeling: A Monte Carlo Simulation StudyStructural Equation Modeling: A Multidisciplinary Journal, 2007
- Efficient Computation of the Hidden Markov Model Entropy for a Given Observation SequenceIEEE Transactions on Information Theory, 2005
- Latent Class Factor and Cluster Models, Bi-Plots, and Related Graphical DisplaysSociological Methodology, 2001
- Assessing a mixture model for clustering with the integrated completed likelihoodIEEE Transactions on Pattern Analysis and Machine Intelligence, 2000
- Choosing models in model-based clustering and discriminant analysisJournal of Statistical Computation and Simulation, 1999
- An improvement of the NEC criterion for assessing the number of clusters in a mixture modelPattern Recognition Letters, 1999
- An entropy criterion for assessing the number of clusters in a mixture modelJournal of Classification, 1996
- Model Selection and Akaike's Information Criterion (AIC): The General Theory and its Analytical ExtensionsPsychometrika, 1987
- Another interpretation of the EM algorithm for mixture distributionsStatistics & Probability Letters, 1986