A Revised Simplex Search Procedure for Stochastic Simulation Response Surface Optimization
Authors:
- 1 November 2000
- journal article
- research article
- Published by Institute for Operations Research and the Management Sciences (INFORMS) in INFORMS Journal on Computing
- Vol. 12 (4) , 272-283
Abstract
We develop a variant of the Nelder-Mead (NM) simplex search procedure for stochastic simulation optimization that is designed to avoid many of the weaknesses encumbering similar direct-search methods—in particular, excessive sensitivity to starting values, premature termination at a local optimum, lack of robustness against noisy responses, and computational inefficiency. The Revised Simplex Search (RSS) procedure consists of a three-phase application of the NM method in which: (a) the ending values for one phase become the starting values for the next phase; (b) the step size for the initial simplex (respectively, the shrink coefficient) decreases geometrically (respectively, increases linearly) over successive phases; and (c) the final estimated optimum is the best of the ending values for the three phases. To compare RSS versus NM and procedure RS+S9 due to Barton and Ivey, we summarize a simulation study based on four selected performance measures computed for six test problems that include additive white-noise error, with three levels of problem dimensionality and noise variability used in each problem. In the selected test problems, RSS yielded significantly more accurate estimates of the optimum than NM or RS+S9, and both RSS and RS+S9 required roughly four times as many function evaluations as NM.Keywords
This publication has 9 references indexed in Scilit:
- A revised simplex search procedure for stochastic simulation response-surface optimization2002
- Least squares estimation of nonhomogeneous poisson processesJournal of Statistical Computation and Simulation, 2000
- Using Univariate Bézier Distributions to Model Simulation Input ProcessesIIE Transactions, 1996
- Nelder-Mead Simplex Modifications for Simulation OptimizationManagement Science, 1996
- Minimizing multimodal functions of continuous variables with the “simulated annealing” algorithm—Corrigenda for this article is available hereACM Transactions on Mathematical Software, 1987
- Testing Unconstrained Optimization SoftwareACM Transactions on Mathematical Software, 1981
- An Analysis of Variance Test for Normality (Complete Samples)Biometrika, 1965
- An analysis of variance test for normality (complete samples)Biometrika, 1965
- A Simplex Method for Function MinimizationThe Computer Journal, 1965