A Comparison of Penalized Maximum Likelihood Estimation and Markov Chain Monte Carlo Techniques for Estimating Confirmatory Factor Analysis Models With Small Sample Sizes
Authors:
Open Access
- 29 April 2021
- journal article
- research article
- Published by Frontiers Media SA in Frontiers in Psychology
- Vol. 12
Abstract
With small to modest sample sizes and complex models, maximum likelihood (ML) estimation of confirmatory factor analysis (CFA) models can show serious estimation problems such as non-convergence or parameter estimates outside the admissible parameter space. In this article, we distinguish different Bayesian estimators that can be used to stabilize the parameter estimates of a CFA: the mode of the joint posterior distribution that is obtained from penalized maximum likelihood (PML) estimation, and the mean (EAP), median (Med), or mode (MAP) of the marginal posterior distribution that are calculated by using Markov Chain Monte Carlo (MCMC) methods. In two simulation studies, we evaluated the performance of the Bayesian estimators from a frequentist point of view. The results show that the EAP produced more accurate estimates of the latent correlation in many conditions and outperformed the other Bayesian estimators in terms of root mean squared error (RMSE). We also argue that it is often advantageous to choose a parameterization in which the main parameters of interest are bounded, and we suggest the four-parameter beta distribution as a prior distribution for loadings and correlations. Using simulated data, we show that selecting weakly informative four-parameter beta priors can further stabilize parameter estimates, even in cases when the priors were mildly misspecified. Finally, we derive recommendations and propose directions for further research.Keywords
All Related Versions
This publication has 117 references indexed in Scilit:
- CADEM: A conditional augmented data EM algorithm for fitting one parameter probit modelsBrazilian Journal of Probability and Statistics, 2013
- Risk of Bayesian Inference in Misspecified Models, and the Sandwich Covariance MatrixEconometrica, 2013
- A 2 × 2 taxonomy of multilevel latent contextual models: Accuracy–bias trade-offs in full and partial error correction models.Psychological Methods, 2011
- A Comparison of Maximum Likelihood and Bayesian Estimation for Polychoric Correlation Using Monte Carlo SimulationJournal of Educational and Behavioral Statistics, 2011
- A comparison of Bayesian and likelihood-based methods for fitting multilevel modelsBayesian Analysis, 2006
- Avoiding Boundary Estimates in Latent Class Analysis by Bayesian Posterior Mode EstimationBehaviormetrika, 2006
- Testing parameters in structural equation modeling: Every "one" matters.Psychological Methods, 2001
- Markov Chain Monte Carlo Convergence Diagnostics: A Comparative ReviewJournal of the American Statistical Association, 1996
- The trait-state-error model for multiwave data.Journal of Consulting and Clinical Psychology, 1995
- The Shape of Correlation MatricesThe American Statistician, 1994