A Stochastic Sequential Quadratic Optimization Algorithm for Nonlinear-Equality-Constrained Optimization with Rank-Deficient Jacobians
- 1 November 2024
- journal article
- research article
- Published by Institute for Operations Research and the Management Sciences (INFORMS) in Mathematics of Operations Research
- Vol. 49 (4) , 2212-2248
Abstract
A sequential quadratic optimization algorithm is proposed for solving smooth nonlinear-equality-constrained optimization problems in which the objective function is defined by an expectation. The algorithmic structure of the proposed method is based on a step decomposition strategy that is known in the literature to be widely effective in practice, wherein each search direction is computed as the sum of a normal step (toward linearized feasibility) and a tangential step (toward objective decrease in the null space of the constraint Jacobian). However, the proposed method is unique from others in the literature in that it both allows the use of stochastic objective gradient estimates and possesses convergence guarantees even in the setting in which the constraint Jacobians may be rank-deficient. The results of numerical experiments demonstrate that the algorithm offers superior performance when compared with popular alternatives. Funding: This material is based upon work supported by the U.S. National Science Foundation’s Division of Computing and Communication Foundations under award [CF-1740796], by the Office of Naval Research under award [N00014-21-1-2532], and by the National Science Foundation under award [2030859] to the Computing Research Association for the CIFellows Project.Keywords
All Related Versions
This publication has 18 references indexed in Scilit:
- CUTEst: a Constrained and Unconstrained Testing Environment with safe threads for mathematical optimizationComputational Optimization and Applications, 2014
- LIBSVMACM Transactions on Intelligent Systems and Technology, 2011
- A Matrix-Free Algorithm for Equality Constrained Optimization Problems with Rank-Deficient JacobiansSIAM Journal on Optimization, 2010
- Failure of global convergence for a class of interior point methods for nonlinear programmingMathematical Programming, 2000
- Solving the Trust-Region Subproblem using the Lanczos MethodSIAM Journal on Optimization, 1999
- The Conjugate Gradient Method and Trust Regions in Large Scale OptimizationSIAM Journal on Numerical Analysis, 1983
- Exact penalty functions in nonlinear programmingMathematical Programming, 1979
- A fast algorithm for nonlinearly constrained optimization calculations1978
- A globally convergent method for nonlinear programmingJournal of Optimization Theory and Applications, 1977
- A Stochastic Approximation MethodThe Annals of Mathematical Statistics, 1951