User Perceptions of a Large Language Model–Based Chatbot for Cognitive Reappraisal of Stress: Mixed Methods Feasibility Study
Open Access
- 22 October 2026
- journal article
- Published by JMIR Publications Inc. in JMIR Human Factors
- Vol. 13, e89736
Abstract
Background: Cognitive reappraisal is a widely studied emotion regulation strategy that helps individuals reinterpret stressful situations in ways that reduce their emotional impact. Digital mental health (DMH) tools often struggle to support this process because scripted templates fail to adapt to the varied and incomplete ways users describe their stressors. Large language models (LLMs) offer opportunities to increase conversational flexibility while preserving structured intervention steps. Objective: This study aimed to examine the feasibility of an LLM-based single-session intervention (SSI) for stress reappraisal. We assessed whether the activity was associated with short-term improvements in stress-related outcomes, and explored the design tensions that arose during user interactions. Methods: We conducted a feasibility study with 100 employees from a large US technology company. Participants completed a structured cognitive reappraisal session delivered by a GPT-4o–based chatbot within Qualtrics. Pre-post measures included situational stress intensity, stress mindset, perceived demand, and perceived resources (all 5-point scales). Paired Wilcoxon signed-rank tests were used with Benjamini-Hochberg correction. To complement self-reports, we analyzed sentiment and stress trajectories across conversation tertiles using a Robustly Optimized BERT Pretraining Approach (RoBERTa; BERT: Bidirectional Encoder Representations from Transformers) sentiment classifier, a RoBERTa stress classifier, and an LLM-based stress rater. We also conducted a thematic analysis of participants’ open-ended responses covering stress impact, perspective change, liked and disliked aspects, and improvement suggestions, alongside their conversation logs. Results: Significant reductions were observed in situational stress intensity (mean 0.29, SD 0.83, r rb =0.54; P =.002) and significant improvements in stress mindset (mean 1.70, SD 4.37, r rb =0.44; P =.002). Sentiment and stress classifiers showed consistent declines in negative sentiment and stress from conversation start to end (all omnibus Friedman tests P <.001). Thematic analysis of open-ended responses surfaced several patterns in how participants engaged with the activity: they valued the structured prompts for organizing their thoughts, described shifts in how they interpreted their stressors, used the interaction to identify concrete next steps, and experienced the chatbot as a nonjudgmental space for reflection. Reported design tensions included perceived scriptedness, variable preferences for conversation length, and mixed reactions to AI-driven empathy. Conclusions: An LLM-enhanced cognitive reappraisal activity showed promise to be delivered as a brief digital intervention and is associated with short-term improvements in situational stress and stress mindset. Participants appreciated the clarity and reflection supported by the structured sequence, while noting important design challenges in balancing structure with conversational naturalness and contextual depth. These findings highlight both the promise and the design constraints of integrating LLMs into DMH interventions.Keywords
This publication has 65 references indexed in Scilit:
- A meta-analysis of cognitive reappraisal and personal resilienceClinical Psychology Review, 2024
- Small Steps over time: A longitudinal usability test of an automated interactive text messaging intervention to support self-management of depression and anxiety symptomsJournal of Affective Disorders, 2023
- How to Improve Others’ Emotions: Reappraise and be ResponsiveAffective Science, 2023
- Reflection as a social phenomenon: a conceptual framework toward group reflection researchEducational Technology Research and Development, 2022
- More than a Feeling: Accuracy and Application of Sentiment AnalysisInternational Journal of Research in Marketing, 2022
- Little Treatments, Promising Effects? Meta-Analysis of Single-Session Interventions for Youth Psychiatric ProblemsJournal of the American Academy of Child & Adolescent Psychiatry, 2017
- Mastering the Art of Chain Analysis in Dialectical Behavior TherapyCognitive and Behavioral Practice, 2014
- How We Design Feasibility StudiesAmerican Journal of Preventive Medicine, 2009
- The Big Five Personality Traits and the Life Course: A 45-Year Longitudinal StudyJournal of Research in Personality, 1999
- Response-shift bias: A source of contamination of self-report measures.Journal of Applied Psychology, 1979