Constrained composite optimization and augmented Lagrangian methods
Top Cited Papers
Open Access
- 8 February 2023
- journal article
- research article
- Published by Springer Nature in Mathematical Programming
- Vol. 201 (1-2) , 863-896
Abstract
We investigate finite-dimensional constrained structured optimization problems, featuring composite objective functions and set-membership constraints. Offering an expressive yet simple language, this problem class provides a modeling framework for a variety of applications. We study stationarity and regularity concepts, and propose a flexible augmented Lagrangian scheme. We provide a theoretical characterization of the algorithm and its asymptotic properties, deriving convergence results for fully nonconvex problems. It is demonstrated how the inner subproblems can be solved by off-the-shelf proximal methods, notwithstanding the possibility to adopt any solvers, insofar as they return approximate stationary points. Finally, we describe our matrix-free implementation of the proposed algorithm and test it numerically. Illustrative examples show the versatility of constrained composite programs as a modeling tool and expose difficulties arising in this vast problem class.Keywords
All Related Versions
Funding Information
- Deutsche Forschungsgemeinschaft (KA 1296/24-2, KA 1296/24-2)
This publication has 50 references indexed in Scilit:
- Proximal AlgorithmsFoundations and Trends® in Optimization, 2014
- A Sequential Quadratic Optimization Algorithm with Rapid Infeasibility DetectionSIAM Journal on Optimization, 2014
- Augmented Lagrangian method with nonmonotone penalty parameters for constrained optimizationComputational Optimization and Applications, 2011
- A primal-dual augmented LagrangianComputational Optimization and Applications, 2010
- On Augmented Lagrangian Methods with General Lower-Level ConstraintsSIAM Journal on Optimization, 2008
- SDP diagonalizations and perspective cuts for a class of nonseparable MIQPOperations Research Letters, 2007
- A Globally Convergent Augmented Lagrangian Algorithm for Optimization with General Constraints and Simple BoundsSIAM Journal on Numerical Analysis, 1991
- On the limited memory BFGS method for large scale optimizationMathematical Programming, 1989
- Augmented Lagrangians and Applications of the Proximal Point Algorithm in Convex ProgrammingMathematics of Operations Research, 1976
- Multiplier and gradient methodsJournal of Optimization Theory and Applications, 1969