Watching AI Think: User Perceptions of Visible Thinking in Chatbots
Authors:
- Samuel Rhys CoxSCSamuel Rhys Cox
- Jade Martin-LiseJMJade Martin-Lise
- Simo HosioSHSimo Hosio
- Niels van BerkelNBNiels van Berkel
Preprint
Abstract
People increasingly turn to conversational agents such as ChatGPT to seek guidance for their personal problems. As these systems grow in capability, many now display elements of "thinking": short reflective statements that reveal a model's intentions or values before responding. While initially introduced to promote transparency, such visible thinking can also anthropomorphise the agent and shape user expectations. Yet little is known about how these displays affect user perceptions in help-seeking contexts. We conducted a 3 x 2 mixed design experiment examining the impact of 'Thinking Content' (None, Emotionally-Supportive, Expertise-Supportive) and 'Conversation Context' (Habit-related vs. Feelings-related problems) on users' perceptions of empathy, warmth, competence, and engagement. Participants interacted with a chatbot that either showed no visible thinking or presented value-oriented reflections prior to its response. Our findings contribute to understanding how thinking transparency influences user experience in supportive dialogues, and offer implications for designing conversational agents that communicate intentions in sensitive, help-seeking scenarios.Keywords
All Related Versions
This publication has 49 references indexed in Scilit:
- Using LLMs for self-care: User and counsellor perspectivesInternational Journal of Human-Computer Studies, 2025
- Use of generative artificial intelligence (AI) in psychiatry and mental health care: a systematic reviewActa Neuropsychiatrica, 2024
- Exploring the Impact of Explainability on Trust and Acceptance of Conversational Agents – A Wizard of Oz Study2024
- Exploring how politeness impacts the user experience of chatbots for mental health supportInternational Journal of Human-Computer Studies, 2023
- Inner speech as language process and cognitive toolTrends in Cognitive Sciences, 2023
- ChatGPT: Empowering lifelong learning in the digital age of higher educationEducation and Information Technologies, 2023
- A longitudinal study of human–chatbot relationshipsInternational Journal of Human-Computer Studies, 2022
- Explanation in artificial intelligence: Insights from the social sciencesArtificial Intelligence, 2019
- Application of Expectancy Violations Theory to communication with and judgments about embodied agents during a decision-making taskInternational Journal of Human-Computer Studies, 2016
- Warmth and Competence as Universal Dimensions of Social Perception: The Stereotype Content Model and the BIAS Map2008