Who is Mturk? Personal characteristics and sample consistency of these online workers
Top Cited Papers
- 8 March 2018
- journal article
- research article
- Published by Taylor & Francis in Mental Health, Religion & Culture
- Vol. 21 (9-10) , 934-944
Abstract
Amazon Mechanical Turk (MTurk) has increasingly attracted the attention of researchers as a convenient method to gather human subjects due to its efficiency, low cost, and ease of use in securing data samples. The current study provides a meta-analytic review across three separate MTurk samples. Participants were 1707 US citizens (774 males and 933 females, aged 18–77 years) recruited from Amazon’s MTurk system. Results indicated that across three MTurk samples, demographic characteristics of workers closely approximated the general US population on gender and race but differed on religious affiliation given the very high number of Atheists and Agnostics (38.3%). Across the three samples, significant mean level differences were observed for 14 of the 15 study scales; however, effect sizes were small (eta2 ranged from .01 to .04). Results suggested that individuals working in the fields of personality and spirituality need to be aware that using an MTurk sample may introduce sample bias in their data.Keywords
This publication has 14 references indexed in Scilit:
- The (Non) Religion of Mechanical Turk WorkersJournal for the Scientific Study of Religion, 2015
- Crowdsourcing and personality measurement equivalence: A warning about countries whose primary language is not EnglishPersonality and Individual Differences, 2015
- Is There a Cost to Convenience? An Experimental Comparison of Data Quality in Laboratory and Online StudiesJournal of Experimental Political Science, 2014
- Nonnaïveté among Amazon Mechanical Turk workers: Consequences and solutions for behavioral researchersBehavior Research Methods, 2013
- Evaluating Online Labor Markets for Experimental Research: Amazon.com's Mechanical TurkPolitical Analysis, 2012
- Conducting behavioral research on Amazon’s Mechanical TurkBehavior Research Methods, 2011
- Amazon's Mechanical TurkPerspectives on Psychological Science, 2011
- Analyzing the Amazon Mechanical Turk marketplaceXRDS: Crossroads, The ACM Magazine for Students, 2010
- Beyond the “Narrow Data Base”: Another Convenience Sample for Experimental ResearchPolitical Behavior, 2007
- The development of markers for the Big-Five factor structure.Psychological Assessment, 1992