Prescriptive Predictors of Mindfulness Ecological Momentary Intervention for Social Anxiety Disorder: Machine Learning Analysis of Randomized Controlled Trial Data (Preprint)
Preprint
- 5 October 2024
- preprint
- Published by JMIR Publications Inc. in JMIR Preprints
Abstract
BACKGROUND Shame and stigma often prevent individuals with social anxiety disorder (SAD) from seeking and attending costly and time-intensive psychotherapies, highlighting the importance of brief, low-cost, and scalable treatments. Creating prescriptive outcome prediction models is thus crucial for identifying which clients with SAD might gain the most from a unique scalable treatment option. Nevertheless, widely used classical regression methods might not optimally capture complex nonlinear associations and interactions. OBJECTIVE Precision medicine approaches were thus harnessed to examine prescriptive predictors of optimization to a 14-day fully self-guided mindfulness ecological momentary intervention (MEMI) over a self-monitoring app (SM). METHODS This study involved 191 participants who had probable SAD. Participants were randomly assigned to MEMI (n=96) or SM (n=95). They completed self-reports of symptoms, risk factors, treatment, and sociodemographics at baseline, posttreatment, and 1-month follow-up (1MFU). Machine learning (ML) models with 17 predictors of optimization to MEMI over SM, defined as a higher probability of SAD remission from MEMI at posttreatment and 1MFU, were evaluated. The Social Phobia Diagnostic Questionnaire, structurally equivalent to the Diagnostic and Statistical Manual SAD criteria, was used to define remission. These ML models included random forest and support vector machines (radial basis function kernel) and 10-fold nested cross-validation that separated model training, minimal tuning in inner folds, and model testing in outer folds. RESULTS ML models outperformed logistic regression. The multivariable ML models using the 10 most important predictors achieved good performance, with the area under the receiver operating characteristic curve (AU-ROC) values ranging from .71 to .72 at posttreatment and 1MFU. These prerandomization and early-stage prescriptive predictors consistently identified which participants had the highest probability of optimization of MEMI over SM after 14 days and 6 weeks from baseline. Significant predictors included 4 strengths (higher trait mindfulness, lower SAD severity, presence of university education, no current psychotropic medication use), 2 weaknesses (higher generalized anxiety severity and clinician-diagnosed depression or anxiety disorder), and 1 sociodemographic variable (Chinese ethnicity). Emotion dysregulation and current psychotherapy predicted remission with inconsistent signs across time points. CONCLUSIONS The AU-ROC values indicated moderately meaningful effect sizes in identifying prescriptive predictors within multivariable models for clients with SAD. Focusing on the identified notable client strengths, weaknesses, and Chinese ethnicity may enhance our ability to predict future responses to scalable treatments. Estimating the likelihood of SAD remission with a “prescriptive predictor calculator” for each client may help clinicians and policymakers allocate scarce treatment resources effectively. Clients with high remission probability may benefit from receiving the MEMI as a vigilant waitlist strategy before intensive therapist-led psychotherapy. These efforts may aid in creating actionable treatment selection tools to optimize care for clients with SAD in routine health care settings that use stratified care principles. CLINICALTRIAL OSF Registries 10.17605/OSF.IO/M3KXZ; https://osf.io/m3kxzKeywords
All Related Versions
- Published version: JMIR Mental Health, 12 (1), e67210.
This publication has 108 references indexed in Scilit:
- Accurate Machine Learning Prediction in Psychiatry Needs the Right Kind of InformationJAMA Psychiatry, 2024
- A Precision Treatment Model for Internet-Delivered Cognitive Behavioral Therapy for Anxiety and Depression Among University StudentsJAMA Psychiatry, 2023
- Stratified Care vs Stepped Care for DepressionJAMA Psychiatry, 2021
- Pragmatic Precision Psychiatry—A New Direction for Optimizing Treatment SelectionJAMA Psychiatry, 2021
- Effects of body-oriented yoga: a RCT study for patients with major depressive disorderEuropean Archives of Psychiatry and Clinical Neuroscience, 2021
- Self‐compassion in mindfulness‐based stress reduction: An examination of prediction and mediation of intervention effectsStress and Health, 2019
- Some methods for heterogeneous treatment effect estimation in high dimensionsStatistics in Medicine, 2018
- A BRIEF ECOLOGICAL MOMENTARY INTERVENTION FOR GENERALIZED ANXIETY DISORDER: A RANDOMIZED CONTROLLED TRIAL OF THEWORRY OUTCOME JOURNALDepression and Anxiety, 2016
- PATIENT TREATMENT PREFERENCE AS A PREDICTOR OF RESPONSE AND ATTRITION IN TREATMENT FOR CHRONIC DEPRESSIONDepression and Anxiety, 2012
- Random Forest for Bioinformatics2012