Variational Properties of Value Functions
Authors:
- Aleksandr Y. AravkinAAAleksandr Y. Aravkin
- James V. BurkeJBJames V. Burke
- Michael P. FriedlanderMFMichael P. Friedlander
- 1 January 2013
- journal article
- research article
- Published by Society for Industrial & Applied Mathematics (SIAM) in SIAM Journal on Optimization
- Vol. 23 (3) , 1689-1717
Abstract
Regularization plays a key role in a variety of optimization formulations of inverse problems. A recurring theme in regularization approaches is the selection of regularization parameters and their effect on the solution and on the optimal value of the optimization problem. The sensitivity of the value function to the regularization parameter can be linked directly to the Lagrange multipliers. This paper characterizes the variational properties of the value functions for a broad class of convex formulations, which are not all covered by standard Lagrange multiplier theory. An inverse function theorem is given that links the value functions of different regularization formulations (not necessarily convex). These results have implications for the selection of regularization parameters, and the development of specialized algorithms. Numerical examples illustrate the theoretical results.Keywords
All Related Versions
This publication has 30 references indexed in Scilit:
- Robust inversion, dimensionality reduction, and randomized samplingMathematical Programming, 2012
- Sparse Optimization with Least-Squares ConstraintsSIAM Journal on Optimization, 2011
- An $\ell _{1}$-Laplace Robust Kalman SmootherIEEE Transactions on Automatic Control, 2011
- Probing the Pareto Frontier for Basis Pursuit SolutionsSIAM Journal on Scientific Computing, 2009
- Robust L1 Principal Component Analysis and Its Bayesian Variational InferenceNeural Computation, 2008
- Least angle regressionThe Annals of Statistics, 2004
- On the mathematical foundations of learningBulletin of the American Mathematical Society, 2001
- New Support Vector AlgorithmsNeural Computation, 2000
- Lagrange Multipliers and OptimalitySIAM Review, 1993
- Theory of reproducing kernelsTransactions of the American Mathematical Society, 1950