A trust-region derivative-free algorithm for constrained optimization
Authors:
- P.D. ConejoPCP.D. Conejo
- E.W. KarasEKE.W. Karas
- L.G. PedrosoLPL.G. Pedroso
- 30 April 2015
- journal article
- Published by Taylor & Francis in Optimization Methods and Software
- Vol. 30 (6) , 1126-1145
Abstract
We propose a trust-region algorithm for constrained optimization problems in which the derivatives of the objective function are not available. In each iteration, the objective function is approximated by a model obtained by quadratic interpolation, which is then minimized within the intersection of the feasible set with the trust region. Since the constraints are handled in the trust-region subproblems, all the iterates are feasible even if some interpolation points are not. The rules for constructing and updating the quadratic model and the interpolation set use ideas from the BOBYQA software, a largely used algorithm for box-constrained problems. The subproblems are solved by ALGENCAN, a competitive implementation of an Augmented Lagrangian approach for general-constrained problems. Some numerical results for the Hock–Schittkowski collection are presented, followed by a performance comparison between our proposal and three derivative-free algorithms found in the literature.Keywords
This publication has 19 references indexed in Scilit:
- On the convergence of trust region algorithms for unconstrained minimization without derivativesComputational Optimization and Applications, 2012
- An active-set trust-region method for derivative-free nonlinear bound-constrained optimizationOptimization Methods and Software, 2011
- Self-Correcting Geometry in Model-Based Algorithms for Derivative-Free Unconstrained OptimizationSIAM Journal on Optimization, 2010
- On the geometry phase in model-based algorithms for derivative-free optimizationOptimization Methods and Software, 2009
- Global Convergence of General Derivative-Free Trust-Region Algorithms to First- and Second-Order Critical PointsSIAM Journal on Optimization, 2009
- Benchmarking Derivative-Free Optimization AlgorithmsSIAM Journal on Optimization, 2009
- Developments of NEWUOA for minimization without derivativesIMA Journal of Numerical Analysis, 2008
- On Augmented Lagrangian Methods with General Lower-Level ConstraintsSIAM Journal on Optimization, 2008
- Geometry of interpolation sets in derivative free optimizationMathematical Programming, 2006
- Benchmarking optimization software with performance profilesMathematical Programming, 2002