On the Performance of Different Regularization Methods in Bifactor-(S-1) Models with Explanatory Variables-Caveats, Recommendations, and Future Directions
- 4 July 2023
- journal article
- research article
- Published by Taylor & Francis in Structural Equation Modeling: A Multidisciplinary Journal
- Vol. 30 (4) , 560-573
Abstract
Regularization methods in linear regression models with manifest variables have been shown to be effective in selecting key predictors from a set of many variables, while improving predictions for novel observations. Regularization methods are particularly attractive for the analysis of complex multidimensional data when theory development is the primary goal; for example when researchers attempt to predict general or specific factors in bifactor models using many potentially relevant predictors. However, applications of regularization methods in such models are still scarce. In a simulation study, we examined the performance of different regularization methods in bifactor-(S-1) models, varying the number of predictors, the correlations with the outcome (effect size), the underlying structure of multicollinearity as well as the sample size, the type of penalty, and a single-step versus a two-step approach. We explore potential caveats in the use of regularization methods in bifactor-(S-1) models, provide practical recommendations, and discuss future directions.Keywords
This publication has 35 references indexed in Scilit:
- A longitudinal multilevel CFA-MTMM model for interchangeable and structurally different methodsFrontiers in Psychology, 2014
- Is there really a single factor of personality? A multirater approach to the apex of personalityJournal of Research in Personality, 2011
- To Explain or to Predict?Statistical Science, 2010
- On the meaning of the latent variables in the CT-C(M-1) model: A comment on Maydeu-Olivares and Coffman (2006).Psychological Methods, 2008
- Regularization and Variable Selection Via the Elastic NetJournal of the Royal Statistical Society Series B: Statistical Methodology, 2005
- Multicollinearity and Measurement Error in Structural Equation Models: Implications for Theory TestingMarketing Science, 2004
- Penalized Regressions: The Bridge versus the LassoJournal of Computational and Graphical Statistics, 1998
- Structural Equation ModelsSociological Methods & Research, 1984
- Estimating the Dimension of a ModelThe Annals of Statistics, 1978
- Ridge Regression: Biased Estimation for Nonorthogonal ProblemsTechnometrics, 1970