Selection Procedures with Frequentist Expected Opportunity Cost Bounds
Authors:
- 1 October 2005
- journal article
- Published by Institute for Operations Research and the Management Sciences (INFORMS) in Operations Research
- Vol. 53 (5) , 867-878
Abstract
Selection procedures help identify the best of a finite set of simulated alternatives. Most work has measured the quality of a selection with the probability of correct selection, P(CS), but the expected opportunity cost of a potentially incorrect decision makes more sense in business contexts. This paper analyzes the first selection procedures that guarantee an upper bound for the expected opportunity cost, in a frequentist sense, of a potentially incorrect selection. The paper therefore bridges a gap between the indifference-zone approach (with frequentist guarantees, but for the P(CS)) and the Bayesian approach to selection procedures (which has considered the opportunity cost). We also provide “unexpected” expected opportunity cost guarantees for several existing indifference-zone selection procedures that were originally designed to provide P(CS) guarantees.Keywords
This publication has 14 references indexed in Scilit:
- New Two-Stage and Sequential Procedures for Selecting the Best Simulated SystemOperations Research, 2001
- New Procedures to Select the Best Simulated System Using Common Random NumbersManagement Science, 2001
- Selecting a good system: procedures and inferenceIIE Transactions, 2001
- Simulation-Based Optimization with Stochastic Approximation Using Common Random NumbersManagement Science, 1999
- An empirical evaluation of several methods to select the best systemACM Transactions on Modeling and Computer Simulation, 1999
- Bayesian look ahead one-stage sampling allocations for selection of the best populationJournal of Statistical Planning and Inference, 1996
- Using Common Random Numbers for Indifference-Zone Selection and Multiple Comparisons in SimulationManagement Science, 1995
- Bayesian look ahead one stage sampling allocations for selecting the largest normal meanStatistical Papers, 1994
- On two-stage selection procedures and related probability-inequalitiesCommunications in Statistics - Theory and Methods, 1978
- A Single-Sample Multiple Decision Procedure for Ranking Means of Normal Populations with known VariancesThe Annals of Mathematical Statistics, 1954