Sparse and Simple Structure Estimation via Prenet Penalization
Authors:
Open Access
- 1 December 2023
- journal article
- research article
- Published by Cambridge University Press (CUP) in Psychometrika
- Vol. 88 (4) , 1381-1406
Abstract
We propose a prenet (product-based elastic net), a novel penalization method for factor analysis models. The penalty is based on the product of a pair of elements in each row of the loading matrix. The prenet not only shrinks some of the factor loadings toward exactly zero but also enhances the simplicity of the loading matrix, which plays an important role in the interpretation of the common factors. In particular, with a large amount of prenet penalization, the estimated loading matrix possesses a perfect simple structure, which is known as a desirable structure in terms of the simplicity of the loading matrix. Furthermore, the perfect simple structure estimation via the proposed penalization turns out to be a generalization of the k-means clustering of variables. On the other hand, a mild amount of the penalization approximates a loading matrix estimated by the quartimin rotation, one of the most commonly used oblique rotation techniques. Simulation studies compare the performance of our proposed penalization with that of existing methods under a variety of settings. The usefulness of the perfect simple structure estimation via our proposed procedure is presented through various real data applications.Keywords
All Related Versions
Funding Information
- Japan Society for the Promotion of Science (19K11862)
This publication has 54 references indexed in Scilit:
- SparseNet: Coordinate Descent With Nonconvex PenaltiesJournal of the American Statistical Association, 2011
- Rotation Criteria and Hypothesis Testing for Exploratory Factor Analysis: Implications for Factor Pattern Loadings and Interfactor CorrelationsEducational and Psychological Measurement, 2011
- Nearly unbiased variable selection under minimax concave penaltyThe Annals of Statistics, 2010
- A Comparative Investigation of Rotation Criteria Within Exploratory Factor AnalysisMultivariate Behavioral Research, 2010
- On the “degrees of freedom” of the lassoThe Annals of Statistics, 2007
- The Adaptive Lasso and Its Oracle PropertiesJournal of the American Statistical Association, 2006
- Regularization and Variable Selection Via the Elastic NetJournal of the Royal Statistical Society Series B: Statistical Methodology, 2005
- The development of markers for the Big-Five factor structure.Psychological Assessment, 1992
- Model selection in covariance structures analysis and the "problem" of sample size: A clarification.Psychological Bulletin, 1991
- An Index of Factorial SimplicityPsychometrika, 1974