Sequential Quadratic Optimization for Stochastic Optimization with Deterministic Nonlinear Inequality and Equality Constraints
- 12 November 2024
- journal article
- research article
- Published by Society for Industrial & Applied Mathematics (SIAM) in SIAM Journal on Optimization
- Vol. 34 (4) , 3592-3622
Abstract
A sequential quadratic optimization algorithm for minimizing an objective function defined by an expectation subject to nonlinear inequality and equality constraints is proposed, analyzed, and tested. The context of interest is when it is tractable to evaluate constraint function and derivative values in each iteration, but it is intractable to evaluate the objective function or its derivatives in any iteration, and instead, an algorithm can only make use of stochastic objective gradient estimates. Under loose assumptions, including that the gradient estimates are unbiased, the algorithm is proved to possess convergence guarantees in expectation. The results of numerical experiments are presented to demonstrate that the proposed algorithm can outperform an alternative approach that relies on the ability to compute more accurate gradient estimates and can outperform a stochastic algorithm that employs a penalty method to enforce the constraints.Keywords
All Related Versions
Funding Information
- Office of Naval Research (N00014-21-1-2532)
- National Science Foundation (CCF-2139735)
This publication has 32 references indexed in Scilit:
- Worst-case complexity of an SQP method for nonlinear equality constrained stochastic optimizationMathematical Programming, 2023
- Inequality constrained stochastic nonlinear optimization via active-set sequential quadratic programmingMathematical Programming, 2023
- An adaptive stochastic sequential quadratic programming with differentiable exact augmented lagrangiansMathematical Programming, 2022
- First-order and Stochastic Optimization Methods for Machine Learning2020
- CUTEst: a Constrained and Unconstrained Testing Environment with safe threads for mathematical optimizationComputational Optimization and Applications, 2014
- On the implementation of an interior-point filter line-search algorithm for large-scale nonlinear programmingMathematical Programming, 2005
- A trust region method based on interior point techniques for nonlinear programmingMathematical Programming, 2000
- A multiplier method with automatic limitation of penalty growthMathematical Programming, 1979
- Superlinearly convergent variable metric algorithms for general nonlinear programming problemsMathematical Programming, 1976
- An exact penalty function for nonlinear programming with inequalitiesMathematical Programming, 1973