The Use of Statistical Significance Tests in Research
Author:
- 1 July 1993
- journal article
- research article
- Published by Taylor & Francis in The Journal of Experimental Education
- Vol. 61 (4) , 361-377
Abstract
Three of the various criticisms of conventional uses of statistical significance testing are elaborated. Three alternatives for augmenting statistical significance tests in interpreting results are then elaborated. These include emphasizing effect sizes, evaluating statistical significance tests in a sample size context, and evaluating result replicability. Ways of estimating result replicability from data in hand include crossvalidation, jackknife, and bootstrap logics. The bootstrap is explored in some detail.Keywords
This publication has 57 references indexed in Scilit:
- Discstra: A Computer Program that Computes Bootstrap Resampling Estimates of Descriptive Discriminant Analysis Function and Structure Coefficients and Group CentroidsEducational and Psychological Measurement, 1992
- Book ReviewsEducational and Psychological Measurement, 1991
- Book ReviewsEducational and Psychological Measurement, 1990
- A Single Contrast Test ProcedureEducational and Psychological Measurement, 1988
- Policy Implications of Using Significance Tests in Evaluation ResearchEvaluation Review, 1984
- Note on the estimation of the squared cross-validated multiple correlation of a regression model.Psychological Bulletin, 1980
- The file drawer problem and tolerance for null results.Psychological Bulletin, 1979
- Theoretical risks and tabular asterisks: Sir Karl, Sir Ronald, and the slow progress of soft psychology.Journal of Consulting and Clinical Psychology, 1978
- Is the ANOVA F-Test Robust to Variance Heterogeneity When Sample Sizes are Equal?: An Investigation via a Coefficient of VariationAmerican Educational Research Journal, 1977
- Consequences of prejudice against the null hypothesis.Psychological Bulletin, 1975