Harmonizing Optimized Designs With Classic Randomization in Experiments
Authors:
- 21 February 2020
- journal article
- research article
- Published by Taylor & Francis in The American Statistician
- Vol. 75 (2) , 195-206
Abstract
There is a long debate in experimental design between the classic randomization design of Fisher, Yates, Kempthorne, Cochran and those who advocate deterministic assignments based on notions of optimality. In non-sequential trials comparing treatment and control, covariate measurements for each subject are known in advance, and subjects can be divided into two groups based on a criterion of imbalance. With the advent of modern computing, this partition can be made nearly perfectly balanced via numerical optimization, but these allocations are far from random. These perfect allocations may endanger estimation relative to classic randomization because unseen subject-specific characteristics can be highly imbalanced. To demonstrate this, we consider different performance criterions such as Efron’s worst-case analysis and our original tail criterion of mean squared error. Under our tail criterion for the differences-in-mean estimator, we prove asymptotically that the optimal design must be more random than perfect balance but is not completely random. This result vindicates restricted designs that are used regularly such as blocking and rerandomization. For a covariate-adjusted estimator, balancing offers less rewards and it seems good performance is achievable with complete randomization. Further work will provide a procedure to find the explicit optimal design in different scenarios in practice.Keywords
All Related Versions
Funding Information
- NSF (DMS RTG 1501767)
This publication has 25 references indexed in Scilit:
- Optimal multivariate matching before randomizationBiostatistics, 2004
- When Good Confidence Intervals Go Bad: Predictor Sort Experiments and ANOVAThe American Statistician, 1999
- Confidence Intervals from Randomization Tests1996
- On the Robustness and Efficiency of Some Randomized DesignsThe Annals of Statistics, 1981
- Experimental Randomization: Who Needs It?The American Statistician, 1975
- Fisher, R. A.: Statistical Methods for Research Workers, 14. Aufl., Oliver & Boyd, Edinburgh, London 1970. XIII, 362 S., 12 Abb., 74 Tab., 40 sBiometrische Zeitschrift, 1971
- An Automatic Method of Solving Discrete Programming ProblemsEconometrica, 1960
- The Randomization Theory of Experimental InferenceJournal of the American Statistical Association, 1955
- Comparison Between Balanced and Random Arrangements of Field PlotsBiometrika, 1938
- ON THE STANDARD DEVIATIONS OF ADJUSTED AND INTERPOLATED VALUES OF AN OBSERVED POLYNOMIAL FUNCTION AND ITS CONSTANTS AND THE GUIDANCE THEY GIVE TOWARDS A PROPER CHOICE OF THE DISTRIBUTION OF OBSERVATIONSBiometrika, 1918