Combating Survey Bots in Online Research: An Integrative Literature Review of Insights and Strategies
Authors:
- Indian Institute of Management KozhikodeIKIndian Institute of Management Kozhikode
- Anjana KarumathilAKAnjana Karumathil
- Ritu TripathiRTRitu Tripathi
- Northwestern UniversityNUNorthwestern University
Open Access
- 31 March 2025
- journal article
- review article
- Published by Association for Information Systems in AIS Transactions on Human-Computer Interaction
- Vol. 17 (1) , 80-109
Abstract
Survey bots pose a major challenge to the integrity and quality of online data. Even though information systems (IS) literature has increasingly recognized bot infiltration, recommendations on mitigation strategies remain largely confined to the disparate academic domains in which researchers studied bots. We use the integrated literature review (ILR) method to analyze relevant studies published from 2010 through 2022 to provide an overview of the extant research on survey bots, identify areas that warrant further scholarship, and highlight state-of-the-art techniques for bot management. We found that the literature on survey bots is fragmented and lacks a set of generalized recommendations for online survey research across contexts. Thus, we consolidate cross-disciplinary themes and propose best practices to researchers and practitioners to combat survey bots. In doing so, our study can serve as a reference point for scholars who investigate this emerging phenomenon. We also provide a decision tree to help scholars and practitioners to use bot management techniques in their online surveys.Keywords
This publication has 115 references indexed in Scilit:
- Addressing fraudulent responses in online surveys: Insights from a web‐based participatory mapping studyPeople and Nature, 2023
- Eating disorder related research using Amazon Mechanical Turk (MTurk): Friend or foe?: Commentary on Burnette et al. (2021)International Journal of Eating Disorders, 2022
- Characteristics and clinical implications of the relationship between veganism and pathological eating behavioursEating and Weight Disorders - Studies on Anorexia, Bulimia and Obesity, 2021
- Ensuring survey research data integrity in the era of internet botsQuality & Quantity, 2021
- Concerns and recommendations for using AmazonMTurkfor eating disorder researchInternational Journal of Eating Disorders, 2021
- Expanding our understanding of the relationship between nonsuicidal self‐injury and suicide attempts: The roles of emotion regulation self‐efficacy and the acquired capability for suicideJournal of Clinical Psychology, 2020
- Cognitive security paradigm for cloud computing applicationsConcurrency and Computation: Practice and Experience, 2019
- “Keep on Turkin’”?Journal of the Academy of Marketing Science, 2018
- Strategies to address participant misrepresentation for eligibility in Web‐based researchInternational Journal of Methods in Psychiatric Research, 2014
- Identifying Multiple Submissions in Internet Research: Preserving Data IntegrityAIDS and Behavior, 2008