Expandable Factor Analysis
Preprint
Abstract
Bayesian sparse factor models have proven useful for characterizing dependence in multivariate data, but scaling computation to large numbers of samples and dimensions is problematic. We propose expandable factor analysis for scalable inference in factor models when the number of factors is unknown. The method relies on a continuous shrinkage prior for efficient maximum a posteriori estimation of a low-rank and sparse loadings matrix. The structure of the prior leads to an estimation algorithm that accommodates uncertainty in the number of factors. We propose an information criterion to select the hyperparameters of the prior. Expandable factor analysis has better false discovery rates and true positive rates than its competitors across diverse simulations. We apply the proposed approach to a gene expression study of aging in mice, illustrating superior results relative to four competing methods.Keywords
All Related Versions
This publication has 20 references indexed in Scilit:
- Selecting the Correct Number of Factors in Approximate Factor Models: The Large Panel Case With Group Bridge EstimatorsJournal of Business & Economic Statistics, 2014
- Sparse estimation via nonconcave penalized likelihood in factor analysis modelStatistics and Computing, 2014
- Sparse Bayesian infinite factor modelsBiometrika, 2011
- A penalized matrix decomposition, with applications to sparse principal components and canonical correlation analysisBiostatistics, 2009
- High-Dimensional Sparse Factor Modeling: Applications in Gene Expression GenomicsJournal of the American Statistical Association, 2008
- Extended Bayesian information criteria for model selection with large model spacesBiometrika, 2008
- A Modified Principal Component Technique Based on the LASSOJournal of Computational and Graphical Statistics, 2003
- Determining the Number of Factors in Approximate Factor ModelsEconometrica, 2002
- Variable Selection via Nonconcave Penalized Likelihood and its Oracle PropertiesJournal of the American Statistical Association, 2001
- Maximum Likelihood from Incomplete Data Via the EM AlgorithmJournal of the Royal Statistical Society Series B: Statistical Methodology, 1977