Tractable Evaluation of Stein's Unbiased Risk Estimate With Convex Regularizers
- 12 October 2023
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Signal Processing
- Vol. 71 (1053587X) , 4330-4341
Abstract
Stein’s unbiased risk estimate (SURE) gives an unbiased estimate of the ℓ 2 risk of any estimator of the mean of a Gaussian random vector. We focus here on the case when the estimator minimizes a quadratic loss term plus a convex regularizer. For these estimators SURE can be evaluated analytically for a few special cases, and generically using recently developed general purpose methods for differentiating through convex optimization problems; these generic methods however do not scale to large problems. In this paper we describe methods for evaluating SURE that handle a wide class of estimators, and also scale to large problem sizes.Keywords
All Related Versions
Funding Information
- National Science Foundation (DGE-1656518, DMS-2032014)
- Office of Naval Research (N00014-20-1-2157, N00014-22-1-2121)
- Simons Foundation (814641)
- ARO (2003514594)
- ACCESS
This publication has 21 references indexed in Scilit:
- First-Order Methods in Optimization2017
- Unbiased Risk Estimates for Singular Value Thresholding and Spectral EstimatorsIEEE Transactions on Signal Processing, 2013
- Gradient methods for minimizing composite functionsMathematical Programming, 2012
- Degrees of freedom in lasso problemsThe Annals of Statistics, 2012
- A First-Order Primal-Dual Algorithm for Convex Problems with Applications to ImagingJournal of Mathematical Imaging and Vision, 2010
- A Fast Iterative Shrinkage-Thresholding Algorithm for Linear Inverse ProblemsSIAM Journal on Imaging Sciences, 2009
- Evaluating Derivatives2008
- On the “degrees of freedom” of the lassoThe Annals of Statistics, 2007
- Regularization and Variable Selection Via the Elastic NetJournal of the Royal Statistical Society Series B: Statistical Methodology, 2005
- A Stochastic Estimator of the Trace of the Influence Matrix for Laplacian Smoothing SplinesCommunications in Statistics - Simulation and Computation, 1989