The Future of Indirect Evidence
Author:
- Bradley EfronBEBradley Efron
Preprint
Abstract
Familiar statistical tests and estimates are obtained by the direct observation of cases of interest: a clinical trial of a new drug, for instance, will compare the drug's effects on a relevant set of patients and controls. Sometimes, though, indirect evidence may be temptingly available, perhaps the results of previous trials on closely related drugs. Very roughly speaking, the difference between direct and indirect statistical evidence marks the boundary between frequentist and Bayesian thinking. Twentieth-century statistical practice focused heavily on direct evidence, on the grounds of superior objectivity. Now, however, new scientific devices such as microarrays routinely produce enormous data sets involving thousands of related situations, where indirect evidence seems too important to ignore. Empirical Bayes methodology offers an attractive direct/indirect compromise. There is already some evidence of a shift toward a less rigid standard of statistical objectivity that allows better use of indirect evidence. This article is basically the text of a recent talk featuring some examples from current practice, with a little bit of futuristic speculation.Keywords
All Related Versions
This publication has 13 references indexed in Scilit:
- Empirical Bayes Estimates for Large-Scale Prediction ProblemsJournal of the American Statistical Association, 2009
- Simultaneous inference: When should hypothesis testing problems be combined?The Annals of Applied Statistics, 2008
- Microarrays, Empirical Bayes and the Two-Groups ModelStatistical Science, 2008
- Prediction of early progression in recently diagnosed IgA nephropathyNephrology Dialysis Transplantation, 2007
- Cross‐subject comparison of principal diffusion direction mapsMagnetic Resonance in Medicine, 2005
- False Discovery Rate–Adjusted Multiple Confidence Intervals for Selected ParametersJournal of the American Statistical Association, 2005
- Gene expression correlates of clinical prostate cancer behaviorCancer Cell, 2002
- Molecular Classification of Cancer: Class Discovery and Class Prediction by Gene Expression MonitoringScience, 1999
- Controlling the False Discovery Rate: A Practical and Powerful Approach to Multiple TestingJournal of the Royal Statistical Society Series B: Statistical Methodology, 1995
- Stein's Paradox in StatisticsScientific American, 1977