Sequential Quadratic Optimization for Stochastic Optimization with Deterministic Nonlinear Inequality and Equality Constraints
Preprint
Abstract
A sequential quadratic optimization algorithm for minimizing an objective function defined by an expectation subject to nonlinear inequality and equality constraints is proposed, analyzed, and tested. The context of interest is when it is tractable to evaluate constraint function and derivative values in each iteration, but it is intractable to evaluate the objective function or its derivatives in any iteration, and instead an algorithm can only make use of stochastic objective gradient estimates. Under loose assumptions, including that the gradient estimates are unbiased, the algorithm is proved to possess convergence guarantees in expectation. The results of numerical experiments are presented to demonstrate that the proposed algorithm can outperform an alternative approach that relies on the ability to compute more accurate gradient estimates.Keywords
All Related Versions
This publication has 13 references indexed in Scilit:
- Constrained Optimization in the Presence of NoiseSIAM Journal on Optimization, 2023
- Inequality constrained stochastic nonlinear optimization via active-set sequential quadratic programmingMathematical Programming, 2023
- Sequential Quadratic Optimization for Nonlinear Equality Constrained Stochastic OptimizationSIAM Journal on Optimization, 2021
- First-order and Stochastic Optimization Methods for Machine Learning2020
- On the implementation of an interior-point filter line-search algorithm for large-scale nonlinear programmingMathematical Programming, 2005
- A globally convergent primal-dual interior point method for constrained optimizationOptimization Methods and Software, 1998
- A multiplier method with automatic limitation of penalty growthMathematical Programming, 1979
- Superlinearly convergent variable metric algorithms for general nonlinear programming problemsMathematical Programming, 1976
- An exact penalty function for nonlinear programming with inequalitiesMathematical Programming, 1973
- Optimum Control, Inequality State Constraints, and the Generalized Newton-Raphson AlgorithmJournal of the Society for Industrial and Applied Mathematics Series A Control, 1965