Survey of Editors and Reviewers of High-Impact Psychology Journals: Statistical and Research Design Problems in Submitted Manuscripts
Authors:
- 31 March 2011
- journal article
- research article
- Published by Taylor & Francis in The Journal of Psychology
- Vol. 145 (3) , 195-209
Abstract
The authors surveyed 21 editors and reviewers from major psychology journals to identify and describe the statistical and design errors they encounter most often and to get their advice regarding prevention of these problems. Content analysis of the text responses revealed themes in 3 major areas: (a) problems with research design and reporting (e.g., lack of an a priori power analysis, lack of congruence between research questions and study design/analysis, failure to adequately describe statistical procedures); (b) inappropriate data analysis (e.g., improper use of analysis of variance, too many statistical tests without adjustments, inadequate strategy for addressing missing data); and (c) misinterpretation of results. If researchers attended to these common methodological and analytic issues, the scientific quality of manuscripts submitted to high-impact psychology journals might be significantly improved.Keywords
This publication has 39 references indexed in Scilit:
- Missing Data Approaches in eHealth Research: Simulation Study and a Tutorial for Nonmathematically Inclined ResearchersJournal of Medical Internet Research, 2010
- Best practices for missing data management in counseling psychology.Journal of Counseling Psychology, 2010
- Type I and Type II error concerns in fMRI research: re-balancing the scaleSocial Cognitive and Affective Neuroscience, 2009
- Influence of Subject Eligibility Criteria on Compliance With National Institutes of Health Guidelines for Inclusion of Women, Minorities, and Children in Treatment ResearchAlcohol, Clinical and Experimental Research, 2007
- Caution Regarding the Use of Pilot Studies to Guide Power Calculations for Study ProposalsArchives of General Psychiatry, 2006
- How Do Risk Factors Work Together? Mediators, Moderators, and Independent, Overlapping, and Proxy Risk FactorsAmerican Journal of Psychiatry, 2001
- Stepwise Selection in Small Data Sets A Simulation Study of Bias in Logistic Regression AnalysisJournal of Clinical Epidemiology, 1999
- In praise of the null hypothesis statistical test.American Psychologist, 1997
- GPOWER: A general power analysis programBehavior Research Methods, Instruments, & Computers, 1996
- Statistical Problems in the Reporting of Clinical TrialsNew England Journal of Medicine, 1987