Misprescription and misuse of one‐tailed tests
- 28 May 2009
- journal article
- review article
- Published by Wiley in Austral Ecology
- Vol. 34 (4) , 447-468
Abstract
One‐tailed statistical tests are often used in ecology, animal behaviour and in most other fields in the biological and social sciences. Here we review the frequency of their use in the 1989 and 2005 volumes of two journals (Animal BehaviourandOecologia), their advantages and disadvantages, the extensive erroneous advice on them in both older and modern statistics texts and their utility in certain narrow areas of applied research. Of those articles with data sets susceptible to one‐tailed tests, at least 24% inAnimal Behaviourand at least 13% inOecologiaused one‐tailed tests at least once. They were used 35% more frequently with nonparametric methods than with parametric ones and about twice as often in 1989 as in 2005. Debate in the psychological literature of the 1950s established the logical criterion that one‐tailed tests should be restricted to situations where there is interest only in results in one direction. ‘Interest’ should be defined; however, in terms of collective or societal interest and not by the individual investigator. By this ‘collective interest’ criterion, all uses of one‐tailed tests in the journals surveyed seem invalid. In his bookNonparametric Statistics,S. Siegel unrelentingly suggested the use of one‐tailed tests whenever the investigator predicts the direction of a result. That work has been a major proximate source of confusion on this issue, but so are most recent statistics textbooks. The utility of one‐tailed tests in research aimed at obtaining regulatory approval of new drugs and new pesticides is briefly described, to exemplify the narrow range of research situations where such tests can be appropriate. These situations are characterized by null hypotheses stating that the difference or effect size does not exceed, or is at least as great as, some ‘amount of practical interest’. One‐tailed tests rarely should be used for basic or applied research in ecology, animal behaviour or any other science.Keywords
This publication has 67 references indexed in Scilit:
- Reporting of Noninferiority and Equivalence Randomized TrialsJAMA, 2006
- Applications: Equivalence Tests Can Enhance Environmental Science and ManagementAustralian & New Zealand Journal of Statistics, 1999
- A comment concerning one-sided tests of significance in new drug applicationsJournal of Biopharmaceutical Statistics, 1991
- Letter to the editor: Some thoughts on two-tailed testsControlled Clinical Trials, 1987
- Reconciling Bayesian and Frequentist Evidence in the One-Sided Testing ProblemJournal of the American Statistical Association, 1987
- Social Facilitation of Mobbing in the Zebra Finch Taeniopygia guttataBird Behavior, 1985
- Influence of Environment on Mobbing by Zebra FinchesBird Behavior, 1985
- The test of significance in psychological research.Psychological Bulletin, 1966
- The concept of statistical significance and the controversy about one-tailed tests.Psychological Review, 1960
- One-tailed tests and "unexpected" results.Psychological Review, 1959