Simple structure estimation via prenet penalization
Preprint
Abstract
We propose a $prenet$ ($pr$oduct $e$lastic $net$), which is a new penalization method for factor analysis models. The penalty is based on the product of a pair of elements in each row of the loading matrix. The prenet not only shrinks some of the factor loadings toward exactly zero, but also enhances the simplicity of the loading matrix, which plays an important role in the interpretation of the common factors. In particular, with a large amount of prenet penalization, the estimated loading matrix possesses a perfect simple structure, which is known as a desirable structure in terms of the simplicity of the loading matrix. Furthermore, the perfect simple structure estimation via the prenet turns out to be a generalization of the $k$-means clustering of variables. On the other hand, a mild amount of the penalization approximates a loading matrix estimated by the quartimin rotation, one of the most commonly used oblique rotation techniques. Thus, the proposed penalty bridges a gap between the perfect simple structure and the quartimin rotation. Monte Carlo simulation is conducted to investigate the performance of the proposed procedure. Three real data analyses are given to illustrate the usefulness of our penalty.
Keywords
All Related Versions
This publication has 25 references indexed in Scilit:
- Functional connectome fingerprinting: identifying individuals using patterns of brain connectivityNature Neuroscience, 2015
- Estimation of an oblique structure via penalized likelihood factor analysisComputational Statistics & Data Analysis, 2014
- Groupwise whole-brain parcellation from resting-state fMRI data for network node identificationNeuroImage, 2013
- A Mathematical Introduction to Compressive Sensing2013
- Extended Bayesian information criteria for model selection with large model spacesBiometrika, 2008
- Rotation to Simple Loadings Using Component Loss Functions: The Orthogonal CasePsychometrika, 2004
- Orthomax Rotation and Perfect Simple StructurePsychometrika, 2003
- Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternativesStructural Equation Modeling: A Multidisciplinary Journal, 1999
- The Varimax Criterion for Analytic Rotation in Factor AnalysisPsychometrika, 1958
- An Analytical Solution for Approximating Simple Structure in Factor AnalysisPsychometrika, 1953