Ranking and selection for pairwise comparison
Open Access
- 10 January 2023
- journal article
- research article
- Published by Wiley in Naval Research Logistics (NRL)
- Vol. 70 (3) , 284-302
Abstract
In many real‐world applications, designs can only be evaluated pairwise, relative to each other. Nevertheless, in the simulation literature, almost all the ranking and selection procedures are developed based on the individual performances of each design. This research considers the statistical ranking and selection problem when the design performance can only be simulated pairwise. We formulate this new problem using the optimal computing budget allocation approach and derive the asymptotic optimality condition based on some approximations. The numerical study indicates that our approach can reduce the number of simulations required to confidently identify the best design.Keywords
Funding Information
- National Natural Science Foundation of China (71971176, 71701123, 71725001, 71910107002)
- Fundamental Research Funds for the Central Universities (JBK2103010)
This publication has 49 references indexed in Scilit:
- Optimal Sampling Laws for Stochastically Constrained Simulation Optimization on Finite SetsINFORMS Journal on Computing, 2013
- The application of discrete event simulation and system dynamics in the logistics and supply chain contextDecision Support Systems, 2012
- Finding the non-dominated Pareto set for multi-objective simulation modelsIIE Transactions, 2010
- A Knowledge-Gradient Policy for Sequential Information CollectionSIAM Journal on Control and Optimization, 2008
- A fully sequential procedure for indifference-zone selection in simulationACM Transactions on Modeling and Computer Simulation, 2001
- Decisions, Error and HeterogeneityThe Economic Journal, 1997
- A lower bound for the correct subset-selection probability and its application to discrete-event system simulationsIEEE Transactions on Automatic Control, 1996
- On two-stage selection procedures and related probability-inequalitiesCommunications in Statistics - Theory and Methods, 1978
- Binary choice probabilities: on the varieties of stochastic transitivityJournal of Mathematical Psychology, 1973
- Rank Analysis of Incomplete Block Designs: I. The Method of Paired ComparisonsBiometrika, 1952