Operator norm consistent estimation of large-dimensional sparse covariance matrices
Author:
- Noureddine El KarouiNKNoureddine El Karoui
Open Access
- 1 December 2008
- journal article
- Published by Institute of Mathematical Statistics in The Annals of Statistics
- Vol. 36 (6) , 2717-2756
Abstract
Estimating covariance matrices is a problem of fundamental importance in multivariate statistics. In practice it is increasingly frequent to work with data matrices X of dimension n×p, where p and n are both large. Results from random matrix theory show very clearly that in this setting, standard estimators like the sample covariance matrix perform in general very poorly. In this “large n, large p” setting, it is sometimes the case that practitioners are willing to assume that many elements of the population covariance matrix are equal to 0, and hence this matrix is sparse. We develop an estimator to handle this situation. The estimator is shown to be consistent in operator norm, when, for instance, we have p≈n as n→∞. In other words the largest singular value of the difference between the estimator and the population covariance matrix goes to zero. This implies consistency of all the eigenvalues and consistency of eigenspaces associated to isolated eigenvalues. We also propose a notion of sparsity for matrices, that is, “compatible” with spectral analysis and is independent of the ordering of the variables.Keywords
All Related Versions
This publication has 20 references indexed in Scilit:
- Spectrum estimation for large dimensional covariance matrices using random matrix theoryThe Annals of Statistics, 2008
- Covariance regularization by thresholdingThe Annals of Statistics, 2008
- Regularized estimation of large covariance matricesThe Annals of Statistics, 2008
- Tracy–Widom limit for the largest eigenvalue of a large class of complex sample covariance matricesThe Annals of Probability, 2007
- Covariance matrix selection and estimation via penalised normal likelihoodBiometrika, 2006
- A CLT for a band matrix modelProbability Theory and Related Fields, 2005
- CLT for linear spectral statistics of large-dimensional sample covariance matricesThe Annals of Probability, 2004
- Empirical Bayes Estimation of the Multivariate Normal Covariance MatrixThe Annals of Statistics, 1980
- A Limit Theorem for the Norm of Random MatricesThe Annals of Probability, 1980
- Probability Inequalities for Sums of Bounded Random VariablesJournal of the American Statistical Association, 1963