Therapist Feedback and Implications on Adoption of an Artificial Intelligence–Based Co-Facilitator for Online Cancer Support Groups: Mixed Methods Single-Arm Usability Study
Authors:
- Yvonne W LeungYLYvonne W Leung
- Steve NgSNSteve Ng
- Lauren DuanLDLauren Duan
- Claire LamCLClaire Lam
- Kenith ChanKCKenith Chan
- Mathew GancarzMGMathew Gancarz
- Heather RennieHRHeather Rennie
- Lianne TrachtenbergLTLianne Trachtenberg
- Kai P ChanKCKai P Chan
- Achini AdikariAAAchini Adikari
- Lin FangLFLin Fang
- David GratzerDGDavid Gratzer
Open Access
- 9 June 2023
- journal article
- research article
- Published by JMIR Publications Inc. in JMIR Cancer
- Vol. 9, e40113
Abstract
Journal of Medical Internet Research - International Scientific Journal for Medical Research, Information and Communication on the Internet #Preprint #PeerReviewMe: Warning: This is a unreviewed preprint. Readers are warned that the document has not been peer-reviewed by expert/patient reviewers or an academic editor, may contain misleading claims, and is likely to undergo changes before final publication, if accepted, or may have been rejected/withdrawn. Readers with interest and expertise are encouraged to sign up as peer-reviewer, if the paper is within an open peer-review period. Please cite this preprint only for review purposes or for grant applications and CVs (if you are the author). Background: The recent onset of the COVID-19 pandemic and the social distancing requirement have created an increased demand for virtual support programs. Advances in artificial intelligence (AI) may offer novel solutions to management challenges such as the lack of emotional connections within virtual group interventions. Using typed text from online support groups, AI can help identify the potential risk of mental health concerns, alert group facilitator(s), and automatically recommend tailored resources while monitoring patient outcomes. Objective: The aim of this mixed methods, single-arm study was to evaluate the feasibility, acceptability, validity, and reliability of an AI-based co-facilitator (AICF) among CancerChatCanada therapists and participants to monitor online support group participants’ distress through a real-time analysis of texts posted during the support group sessions. Specifically, AICF (1) generated participant profiles with discussion topic summaries and emotion trajectories for each session, (2) identified participant(s) at risk for increased emotional distress and alerted the therapist for follow-up, and (3) automatically suggested tailored recommendations based on participant needs. Online support group participants consisted of patients with various types of cancer, and the therapists were clinically trained social workers. Methods: Our study reports on the mixed methods evaluation of AICF, including therapists’ opinions as well as quantitative measures. AICF’s ability to detect distress was evaluated by the patient's real-time emoji check-in, the Linguistic Inquiry and Word Count software, and the Impact of Event Scale-Revised. Results: Although quantitative results showed only some validity of AICF’s ability in detecting distress, the qualitative results showed that AICF was able to detect real-time issues that are amenable to treatment, thus allowing therapists to be more proactive in supporting every group member on an individual basis. However, therapists are concerned about the ethical liability of AICF’s distress detection function. Conclusions: Future works will look into wearable sensors and facial cues by using videoconferencing to overcome the barriers associated with text-based online support groups.Keywords
All Related Versions
This publication has 37 references indexed in Scilit:
- Factor structure and validity of the Therapeutic Factors Inventory–Short Form.Group Dynamics: Theory, Research, and Practice, 2011
- Can seeking happiness make people unhappy? Paradoxical effects of valuing happiness.Emotion, 2011
- An evaluation of the Brief Symptom Inventory–18 using item response theory: Which items are most strongly related to psychological distress?Psychological Assessment, 2011
- The Psychological Meaning of Words: LIWC and Computerized Text Analysis MethodsJournal of Language and Social Psychology, 2009
- “What concerns me is…” Expression of emotion by advanced cancer patients during outpatient visitsSupportive Care in Cancer, 2007
- The Impact of Event Scale: Revised2007
- The lay assessment of subclinical depression in daily life.Psychological Assessment, 2006
- The value of the Hospital Anxiety and Depression Scale (HADS) for comparing women with early onset breast cancer with population-based reference womenQuality of Life Research, 2004
- Cohesion and Performance in Groups: A Meta-Analytic Clarification of Construct Relations.Journal of Applied Psychology, 2003
- Development and validation of the Counselor Activity Self-Efficacy Scales.Journal of Counseling Psychology, 2003