Research in Social Psychology Changed Between 2011 and 2016: Larger Sample Sizes, More Self-Report Measures, and More Online Studies
Authors:
- 12 April 2019
- journal article
- research article
- Published by SAGE Publications in Advances in Methods and Practices in Psychological Science
- Vol. 2 (2) , 107-114
Abstract
The debate about false positives in psychological research has led to a demand for higher statistical power. To meet this demand, researchers need to collect data from larger samples—which is important to increase replicability, but can be costly in both time and money (i.e., remuneration of participants). Given that researchers might need to compensate for these higher costs, we hypothesized that larger sample sizes might have been accompanied by more frequent use of less costly research methods (i.e., online data collection and self-report measures). To test this idea, we analyzed social psychology studies published in 2009, 2011, 2016, and 2018. Indeed, research reported in 2016 and 2018 (vs. 2009 and 2011) had larger sample sizes and relied more on online data collection and self-report measures. Thus, over these years, research improved in its statistical power, but also changed with regard to the methods applied. Implications for social psychology as a discipline are discussed.Keywords
This publication has 18 references indexed in Scilit:
- The MTurkification of Social and Personality PsychologyPersonality and Social Psychology Bulletin, 2018
- The state of social and personality science: Rotten to the core, not so bad, getting better, or getting worse?Journal of Personality and Social Psychology, 2017
- On the unnecessary ubiquity of hierarchical linear modeling.Psychological Methods, 2017
- Approaching a fair deal for significance and other concernsJournal of Experimental Social Psychology, 2016
- Let's PublishFewerPapersPsychological Inquiry, 2012
- Manipulation Checks as Manipulation: Another Look at the Ease-of-Retrieval HeuristicPersonality and Social Psychology Bulletin, 2009
- Psychology as the Science of Self-Reports and Finger Movements: Whatever Happened to Actual Behavior?Perspectives on Psychological Science, 2007
- The APA 1998 Annual Report.American Psychologist, 1999
- A power primer.Psychological Bulletin, 1992
- Progress in Small Group ResearchAnnual Review of Psychology, 1990