A Stochastic Sequential Quadratic Optimization Algorithm for Nonlinear Equality Constrained Optimization with Rank-Deficient Jacobians
Preprint
Abstract
A sequential quadratic optimization algorithm is proposed for solving smooth nonlinear equality constrained optimization problems in which the objective function is defined by an expectation of a stochastic function. The algorithmic structure of the proposed method is based on a step decomposition strategy that is known in the literature to be widely effective in practice, wherein each search direction is computed as the sum of a normal step (toward linearized feasibility) and a tangential step (toward objective decrease in the null space of the constraint Jacobian). However, the proposed method is unique from others in the literature in that it both allows the use of stochastic objective gradient estimates and possesses convergence guarantees even in the setting in which the constraint Jacobians may be rank deficient. The results of numerical experiments demonstrate that the algorithm offers superior performance when compared to popular alternatives.Keywords
All Related Versions
This publication has 10 references indexed in Scilit:
- An adaptive stochastic sequential quadratic programming with differentiable exact augmented lagrangiansMathematical Programming, 2022
- Sequential Quadratic Optimization for Nonlinear Equality Constrained Stochastic OptimizationSIAM Journal on Optimization, 2021
- Generalized stochastic Frank–Wolfe algorithm with stochastic “substitute” gradient for structured convex optimizationMathematical Programming, 2020
- Stochastic Subgradient Method Converges on Tame FunctionsFoundations of Computational Mathematics, 2019
- Optimization Methods for Large-Scale Machine LearningSIAM Review, 2018
- A Matrix-Free Algorithm for Equality Constrained Optimization Problems with Rank-Deficient JacobiansSIAM Journal on Optimization, 2010
- Solving the Trust-Region Subproblem using the Lanczos MethodSIAM Journal on Optimization, 1999
- The Conjugate Gradient Method and Trust Regions in Large Scale OptimizationSIAM Journal on Numerical Analysis, 1983
- Exact penalty functions in nonlinear programmingMathematical Programming, 1979
- A globally convergent method for nonlinear programmingJournal of Optimization Theory and Applications, 1977