The Future of Indirect Evidence
Author:
Open Access
- 1 May 2010
- journal article
- research article
- Published by Institute of Mathematical Statistics in Statistical Science
- Vol. 25 (2) , 145-157
Abstract
Familiar statistical tests and estimates are obtained by the direct observation of cases of interest: a clinical trial of a new drug, for instance, will compare the drug’s effects on a relevant set of patients and controls. Sometimes, though, indirect evidence may be temptingly available, perhaps the results of previous trials on closely related drugs. Very roughly speaking, the difference between direct and indirect statistical evidence marks the boundary between frequentist and Bayesian thinking. Twentieth-century statistical practice focused heavily on direct evidence, on the grounds of superior objectivity. Now, however, new scientific devices such as microarrays routinely produce enormous data sets involving thousands of related situations, where indirect evidence seems too important to ignore. Empirical Bayes methodology offers an attractive direct/indirect compromise. There is already some evidence of a shift toward a less rigid standard of statistical objectivity that allows better use of indirect evidence. This article is basically the text of a recent talk featuring some examples from current practice, with a little bit of futuristic speculation.Keywords
All Related Versions
This publication has 18 references indexed in Scilit:
- Empirical Bayes Estimates for Large-Scale Prediction ProblemsJournal of the American Statistical Association, 2009
- Microarrays, Empirical Bayes and the Two-Groups ModelStatistical Science, 2008
- Prediction of early progression in recently diagnosed IgA nephropathyNephrology Dialysis Transplantation, 2007
- Cross‐subject comparison of principal diffusion direction mapsMagnetic Resonance in Medicine, 2005
- False Discovery Rate–Adjusted Multiple Confidence Intervals for Selected ParametersJournal of the American Statistical Association, 2005
- Large-Scale Simultaneous Hypothesis TestingJournal of the American Statistical Association, 2004
- Robbins, empirical Bayes and microarraysThe Annals of Statistics, 2003
- R. A. Fisher in the 21st century (Invited paper presented at the 1996 R. A. Fisher Lecture)Statistical Science, 1998
- Stein's Paradox in StatisticsScientific American, 1977
- Admissible Estimators, Recurrent Diffusions, and Insoluble Boundary Value ProblemsThe Annals of Mathematical Statistics, 1971