Artificial-Intelligence-Mediated Contamination in Online Research: Taxonomy, Risk Gradient, and Recommendations
Author:
Open Access
- 9 July 2026
- journal article
- research article
- Published by SAGE Publications in Advances in Methods and Practices in Psychological Science
- Vol. 9 (3)
Abstract
For 2 decades, online research has relied on a quality heuristic: Careful, coherent responding is good data. That heuristic is no longer reliable. Autonomous artificial-intelligence (AI) agents can now pass nearly all conventional quality checks, and in text-rich crowd-work tasks, reported use of large language models approaches one third. When such consultation shapes the response process itself—not just its surface expression—the resulting data appear human-generated while embedding systematic, model-shaped distortions. I synthesize emerging evidence on how AI-mediated contamination varies across research settings in prevalence, mechanism, and inferential consequence; and distinguish three contamination pathways (full delegation, partial mediation, and spillover) and three vulnerability zones (text-rich tasks at highest risk, browser-based cognitive paradigms as an emerging vulnerability, and supervised or identity-vetted settings at lower risk). Even modest contamination can shift estimated public opinion, compress attitudinal extremes, and, over time, feed back into the training data for future models. Current platform countermeasures may raise the cost of contamination but have not been independently validated under adversarial conditions. I argue for a shift from ad hoc detection to infrastructure redesign: contamination-aware sensitivity analyses, explicit stratification of data collection by evidential role, transparency norms that balance open science with adversarial robustness, and a minimum reporting checklist for online studies in vulnerable settings. I close by asking when AI mediation should be treated not as contamination but as part of the ecological baseline of human responding—a question that requires the field to specify the target cognitive system in any given study.Keywords
All Related Versions
Funding Information
- Yonsei Fellowship
This publication has 40 references indexed in Scilit:
- Recognising and mitigating LLM Pollution in online behavioural researchNature Communications, 2026
- Digital Surveillance and Self-Censorship in Autocracies: Evidence from a Survey Experiment in KazakhstanPolitical Behavior, 2026
- Initial Attempts to Detect or Screen Out AI Responses Prove Elusive in the Age of Agentic AIInternational Journal of Eating Disorders, 2026
- AI chatbots are already biasing research — we must establish guidelines for their use nowNature, 2025
- Synthetic Replacements for Human Survey Data? The Perils of Large Language ModelsPolitical Analysis, 2024
- GPT detectors are biased against non-native English writersPatterns, 2023
- Participant carelessness and fraud: Consequences for clinical research and potential solutions.Journal of Abnormal Psychology, 2020
- Identifying careless responses in survey data.Psychological Methods, 2012
- Data Collection in a Flat World: The Strengths and Weaknesses of Mechanical Turk SamplesJournal of Behavioral Decision Making, 2012
- The Concept of Validity.Psychological Review, 2004