Variable selection via the weighted group lasso for factor analysis models
Authors:
- 17 May 2012
- journal article
- research article
- Published by Wiley in Canadian Journal of Statistics
- Vol. 40 (2) , 345-361
Abstract
We consider the problem of selecting variables in factor analysis models. The$L_1$ regularization procedure is introduced to perform an automatic variable selection. In the factor analysis model, each variable is controlled by multiple factors when there are more than one underlying factor. We treat parameters corresponding to the multiple factors as grouped parameters, and then apply the group lasso. Furthermore, the weight of the group lasso penalty is modified to obtain appropriate estimates and improve the performance of variable selection. Crucial issues in this modeling procedure include the selection of the number of factors and a regularization parameter. Choosing these parameters can be viewed as a model selection and evaluation problem. We derive a model selection criterion for evaluating the factor analysis model via the weighted group lasso. Monte Carlo simulations are conducted to investigate the effectiveness of the proposed procedure. A real data example is also given to illustrate our procedure.The Canadian Journal of Statistics40: 345–361; 2012 © 2012 Statistical Society of CanadaKeywords
This publication has 26 references indexed in Scilit:
- On the “degrees of freedom” of the lassoThe Annals of Statistics, 2007
- The Adaptive Lasso and Its Oracle PropertiesJournal of the American Statistical Association, 2006
- Regularization and Variable Selection Via the Elastic NetJournal of the Royal Statistical Society Series B: Statistical Methodology, 2005
- Bayesian information criteria and smoothing parameter selection in radial basis function networksBiometrika, 2004
- Model evaluation and information criteria in covariance structure analysisBritish Journal of Mathematical and Statistical Psychology, 1999
- Accurate Approximations for Posterior Moments and Marginal DensitiesJournal of the American Statistical Association, 1986
- Some Criteria for Variable Selection in Factor AnalysisBehaviormetrika, 1983
- A Proposition of Generalized Method for Forward Selection of VariablesBehaviormetrika, 1980
- Estimating the Dimension of a ModelThe Annals of Statistics, 1978
- A RAPIDLY CONVERGENT METHOD FOR MAXIMUM‐LIKELIHOOD FACTOR ANALYSISBritish Journal of Mathematical and Statistical Psychology, 1970