Understanding People’s Willingness to Participate in Human-LLM Conversational Interaction Research Studies - A Scenario Study
Preprint
- 14 February 2026
- preprint
- Published by Elsevier in SSRN Electronic Journal
Abstract
As Large Language Models (LLMs) become integrated into human-subjects research, understanding how participants perceive and consent to data use is central to building transparent and trustworthy research practices. We conducted a scenario-based study in which 157 participants evaluated 12 scenarios (sampled from a pool of 864), each varying across seven parameters: topic sensitivity, LLM management, data anonymization, data retention, model training, additional data access, and additional consent. We find that the effect of parameters on participants' willingness to participate was mediated by their perceptions of comfort, usefulness, safety, appropriateness, and trust. Anonymization and explicit consent increased participation willingness, while longer retention and broader data access reduced it. Surprisingly, corporate LLM management (vs. federal) did not reduce participation, and data use for model training or personalization---despite potential data leakage---increased willingness to participate. We conclude with design implications for consent processes, transparency mechanisms, and governance practices that align research with participant expectations.Keywords
This publication has 50 references indexed in Scilit:
- The role of learner trust in generative artificially intelligent learning environmentsJournal of Engineering Education, 2025
- Friend or foe? Exploring the implications of large language models on the science systemAI & SOCIETY, 2023
- I, chatbot! the impact of anthropomorphism and gaze direction on willingness to disclose personal information and behavioral intentionsPsychology & Marketing, 2023
- Finding the sweet spot: a qualitative study exploring patients’ acceptability of chatbots in genetic service deliveryHuman Genetics, 2023
- User-Tailored Privacy2021
- Sexual and Gender Minority Youth’s Perspectives on Sharing De-identified Data in Sexual Health and HIV Prevention ResearchSexuality Research and Social Policy, 2019
- Repacking ‘Privacy’ for a Networked WorldComputer Supported Cooperative Work (CSCW), 2017
- Public Attitudes toward Consent and Data Sharing in Biobank Research: A Large Multi-site Experimental Survey in the USThe American Journal of Human Genetics, 2017
- Privacy Aspects of Recommender Systems2015
- Personalization versus Privacy: An Empirical Examination of the Online Consumer’s DilemmaInformation Technology and Management, 2005