Sparse estimation of large covariance matrices via a nested Lasso penalty
Authors:
- Elizaveta LevinaELElizaveta Levina
- Adam RothmanARAdam Rothman
- Ji ZhuJZJi Zhu
Open Access
- 1 March 2008
- journal article
- Published by Institute of Mathematical Statistics in The Annals of Applied Statistics
- Vol. 2 (1) , 245-263
Abstract
The paper proposes a new covariance estimator for large covariance matrices when the variables have a natural ordering. Using the Cholesky decomposition of the inverse, we impose a banded structure on the Cholesky factor, and select the bandwidth adaptively for each row of the Cholesky factor, using a novel penalty we call nested Lasso. This structure has more flexibility than regular banding, but, unlike regular Lasso applied to the entries of the Cholesky factor, results in a sparse estimator for the inverse of the covariance matrix. An iterative algorithm for solving the optimization problem is developed. The estimator is compared to a number of other covariance estimators and is shown to do best, both in simulations and on a real data example. Simulations show that the margin by which the estimator outperforms its competitors tends to increase with dimension.Keywords
All Related Versions
This publication has 28 references indexed in Scilit:
- On Consistency and Sparsity for Principal Components Analysis in High DimensionsJournal of the American Statistical Association, 2009
- High dimensional covariance matrix estimation using a factor modelJournal of Econometrics, 2008
- Covariance matrix selection and estimation via penalised normal likelihoodBiometrika, 2006
- Efficient estimation of covariance selection modelsBiometrika, 2003
- Parsimonious Covariance Matrix Estimation for Longitudinal DataJournal of the American Statistical Association, 2002
- PREOPERATIVE SERUM PROSTATE SPECIFIC ANTIGEN LEVELS BETWEEN 2 AND 22 NG./ML. CORRELATE POORLY WITH POST-RADICAL PROSTATECTOMY CANCER MORPHOLOGY: PROSTATE SPECIFIC ANTIGEN CURE RATES APPEAR CONSTANT BETWEEN 2 AND 9 NG./ML.Journal of Urology, 2002
- Regularized Discriminant AnalysisJournal of the American Statistical Association, 1989
- Estimation of a Covariance Matrix under Stein's LossThe Annals of Statistics, 1985
- Covariance Selection1972
- Ridge Regression: Biased Estimation for Nonorthogonal ProblemsTechnometrics, 1970