The Problem of Statistical Power in MIS Research
Authors:
- 1 March 1989
- journal article
- Published by MIS Quarterly in MIS Quarterly
- Vol. 13 (1) , 87-106
Abstract
Statistical power is a topic of importance to any researcher using statistical inference testing. Studies with low levels of statistical power usually result in inconclusive findings, even though the researcher may have expended much time and effort gathering the data for analysis. A survey of the statistical power of articles employing statistical inference testing published in leading MIS journals shows that their statistical power is, on average, substantially below accepted norms. The consequence of this low power is that MIS researchers typically have a 40 percent chance of not detecting the phenomenon under study, even though it, in fact, may exist. Fortunately, there are several techniques, beyond expanding the sample size (which often may be impossible), that researchers can use to improve the power of their studies. Some are as easy as using a different but more powerful statistical test, while others require developing more elaborate sampling plans or a more careful construction of the research design. Attention to the statistical power of a study is one key ingredient in assuring the success of the study. This article should serve as a useful guide for MIS researchers in the planning, execution, and interpretation of inferential statistical analyses.Keywords
This publication has 36 references indexed in Scilit:
- Interpretation of significance levels and effect sizes by psychological researchers.American Psychologist, 1986
- A meta-analysis and conceptual critique of research on role ambiguity and role conflict in work settingsOrganizational Behavior and Human Decision Processes, 1985
- Naturalistic inquiryInternational Journal of Intercultural Relations, 1985
- Statistical power of differential validity and differential prediction analyses for detecting measurement nonequivalence.Journal of Applied Psychology, 1984
- On the origins of the .05 level of statistical significance.American Psychologist, 1982
- Sample sizes for specified statistical power in testing for differential validity.Journal of Applied Psychology, 1980
- Validation and statistical power: Implications for applied research.Journal of Applied Psychology, 1978
- Optimal sampling strategies for validation studies.Journal of Applied Psychology, 1978
- Statistical power in criterion-related validation studies.Journal of Applied Psychology, 1976
- A statistical power analysis of applied psychological research.Journal of Applied Psychology, 1976