Malignant side effects of null-hypothesis significance testing
Author:
- 16 April 2014
- journal article
- research article
- Published by SAGE Publications in Theory & Psychology
- Vol. 24 (2) , 256-277
Abstract
Six decades-worth of published information has shown irrefutably that null-hypothesis significance tests (NHSTs) provide no information about the reliability of research outcomes. Nevertheless, they are still the core of editorial decision-making in Psychology. Two reasons appear to contribute to the continuing practice. One, survey information suggests that a majority of psychological researchers incorrectly believe that p values provide information about reliability of results. Two, a position sometimes taken is that using them to make decisions has been essentially benign. The mistaken belief has been pointed out many times, so it is briefly covered because of the apparent persistence of the misunderstanding. The idea that NHSTs have been benign is challenged by seven “side-effects” that continue to retard effective development of psychological science. The article concludes with both a few suggestions about possible alternatives and a challenge to psychological researchers to develop new methods that actually assess the reliability of research findings.Keywords
This publication has 44 references indexed in Scilit:
- Psychology as the Science of Self-Reports and Finger Movements: Whatever Happened to Actual Behavior?Perspectives on Psychological Science, 2007
- Confidence intervals and replication: Where will the next mean fall?Psychological Methods, 2006
- Risk factors for suicide in psychiatric outpatients: A 20-year prospective study.Journal of Consulting and Clinical Psychology, 2000
- On the Surprising Longevity of Flogged Horses: Why There Is a Case for the Significance TestPsychological Science, 1997
- The earth is round (p < .05).American Psychologist, 1994
- Things I have learned (so far).American Psychologist, 1990
- The Case Against Statistical Significance TestingHarvard Educational Review, 1978
- The test of significance in psychological research.Psychological Bulletin, 1966
- The statistical power of abnormal-social psychological research: A review.The Journal of Abnormal and Social Psychology, 1962
- Tests of Significance Considered as EvidenceJournal of the American Statistical Association, 1942