Active Sets, Nonsmoothness, and Sensitivity
Author:
- A. S. LewisALA. S. Lewis
- 1 January 2002
- journal article
- Published by Society for Industrial & Applied Mathematics (SIAM) in SIAM Journal on Optimization
- Vol. 13 (3) , 702-725
Abstract
Nonsmoothness pervades optimization, but the way it typically arises is highly structured. Nonsmooth behavior of an objective function is usually associated, locally, with an active manifold: on this manifold the function is smooth, whereas in normal directions it is "vee-shaped." Active set ideas in optimization depend heavily on this structure. Important examples of such functions include the pointwise maximum of some smooth functions and the maximum eigenvalue of a parametrized symmetric matrix. Among possible foundations for practical nonsmooth optimization, this broad class of "partly smooth" functions seems a promising candidate, enjoying a powerful calculus and sensitivity theory. In particular, we show under a natural regularity condition that critical points of partly smooth functions are stable: small perturbations to the function cause small movements of the critical point on the active manifold.Keywords
This publication has 21 references indexed in Scilit:
- Optimal Stability and Eigenvalue MultiplicityFoundations of Computational Mathematics, 2001
- Lectures on Modern Convex Optimization2001
- Perturbation Analysis of Optimization Problems2000
- An Efficient Primal-Dual Interior-Point Method for Minimizing a Sum of Euclidean NormsSIAM Journal on Scientific Computing, 2000
- The 𝒰-Lagrangian of a convex functionTransactions of the American Mathematical Society, 1999
- Practical Aspects of the Moreau--Yosida Regularization: Theoretical PreliminariesSIAM Journal on Optimization, 1997
- A projected newton method forl p norm location problemsMathematical Programming, 1987
- Matrix Analysis1985
- A Short Introduction to Perturbation Theory for Linear Operators1982
- A Stable Algorithm for Solving the Multifacility Location Problem Involving Euclidean DistancesSIAM Journal on Scientific and Statistical Computing, 1980