A Simulation Study on Latent Transition Analysis for Examining Profiles and Trajectories in Education: Recommendations for Fit Statistics
Open Access
- 1 November 2022
- journal article
- research article
- Published by Taylor & Francis in Journal of Research on Educational Effectiveness
- Vol. 16 (2) , 350-375
Abstract
Latent transition analysis is an informative statistical tool for depicting heterogeneity in learning as latent profiles. We present a Monte Carlo simulation study to guide researchers in selecting fit indices for identifying the correct number of profiles. We simulated data representing profiles of learners within a typical pre- post- follow up-design with continuous indicators, varying sample size (N from 50 to 1,000), attrition rate (none/10% per wave), and profile separation (entropy; from .73 to .87). Results indicate that the most commonly used fit index, the Bayesian information criterion (BIC), and the consistent Akaike information criterion (CAIC) consistently underestimate the real number of profiles. A combination of the AIC or the AIC3 with the adjusted Bayesian Information Criterion (aBIC) provides the most precise choice for selecting the number of profiles and is accurate with sample sizes of at least N = 200. The AIC3 excels starting from N = 500. Results were mostly robust toward differing numbers of time points, profiles, indicator variables, and alternative profiles. We provide an online tool for computing these fit indices and discuss implications for research.Keywords
This publication has 39 references indexed in Scilit:
- Profiles of inconsistent knowledge in children’s pathways of conceptual change.Developmental Psychology, 2013
- Cognitive profile of adolescents with math disabilities: Are the profiles different from those with reading disabilities?Child Neuropsychology, 2011
- Effects of class size and adaptive teaching competency on classroom processes and academic outcomeLearning and Instruction, 2011
- Addressing the Problem of Switched Class Labels in Latent Variable Mixture Model Simulation StudiesStructural Equation Modeling: A Multidisciplinary Journal, 2011
- Children’s knowledge of the earth: A new methodological and statistical approachJournal of Experimental Child Psychology, 2008
- Tracking children who fly below the radar: Latent transition modeling of students with late-emerging reading disabilityLearning and Individual Differences, 2008
- How to detect cognitive strategies: commentary on ‘Differentiation and integration: guiding principles for analyzing cognitive change’Developmental Science, 2008
- Deciding on the Number of Classes in Latent Class Analysis and Growth Mixture Modeling: A Monte Carlo Simulation StudyStructural Equation Modeling: A Multidisciplinary Journal, 2007
- Dealing With Label Switching in Mixture ModelsJournal of the Royal Statistical Society Series B: Statistical Methodology, 2000
- Model Selection Information Criteria for Non-Nested Latent Class ModelsJournal of Educational and Behavioral Statistics, 1997