Effectiveness of Conversational Agents for Depression and Anxiety: Systematic Review and Network Dose-Response Meta-Analysis of Agent Types, Dose, and Human Support (Preprint)
Preprint
- 9 June 2026
- preprint
- Published by JMIR Publications Inc. in JMIR Preprints
Abstract
BACKGROUND Conversational agents (CAs) are increasingly used to deliver scalable interventions for depression and anxiety, but existing evidence has often treated these tools as a single category. The comparative effectiveness of different agent types, intervention doses, and levels of human support remains unclear. OBJECTIVE This review systematically evaluated the comparative effectiveness of various CA modalities and levels of human support, as well as potential dose-response relationships across different CA types. METHODS A comprehensive search of PubMed, Embase, Web of Science, Scopus, Ovid, CINAHL, and Psychology and Behavioral Sciences Collection (PBSC) databases was conducted from inception to December 2025. Eligible studies were randomized controlled trials (RCTs) evaluating CA-based interventions. We conducted a random-effects network meta-analysis (NMA) using postintervention outcomes and assessed inconsistency and risk of bias (RoB). Evidence certainty was assessed using the CINeMA (confidence in network meta-analysis) framework. Where data permitted, model-based network dose-response meta-analysis (MBNMA) was performed to examine dose-response associations. RESULTS A total of 41 studies (n=7577) were included. NMA showed that AI-enhanced intensive human support (AEIHS) appeared to produce greater symptom improvement for depression and anxiety compared with pure human digital guidance (PHDG; Hedges g=–4.28, 95% CI –5.56 to –2.99) and open-ended multimodal-enhanced chatbot (OEMM; Hedges g=–4.49, 95% CI –6.31 to –2.66), whereas most other comparisons were not statistically significant. MBNMA indicated that goal-oriented conversational agent (GOCA) and highly structured modular chatbot (HSMC) appeared to exhibit nonlinear effects, with preliminary evidence suggesting potentially enhanced response at low-to-moderate doses, though these findings require further investigation. However, publication bias was detected for depression (Egger P=.02), and the overall certainty of evidence was very low, primarily due to RoB, indirectness, and imprecision. CONCLUSIONS While hybrid CA models with enhanced human involvement appeared to show potential advantages over fully automated systems, the evidence base remains limited. The very low certainty of evidence constrains confidence in comparative rankings and dose recommendations. Future high-quality trials are needed to establish optimal CA architectures and intervention doses for scalable mental health care. CLINICALTRIAL PROSPERO CRD420251145207; https://www.crd.york.ac.uk/PROSPERO/view/CRD420251145207All Related Versions
- Published version: Journal of Medical Internet Research, 28, e104186.
This publication has 37 references indexed in Scilit:
- Can Acceptance, Mindfulness, and Self-Compassion Be Learned by Smartphone Apps? A Systematic and Meta-Analytic Review of Randomized Controlled TrialsBehavior Therapy, 2020
- CINeMA: Software for semiautomated assessment of the confidence in the results of network meta‐analysisCampbell Systematic Reviews, 2020
- The efficacy of app‐supported smartphone interventions for mental health problems: a meta‐analysis of randomized controlled trialsWorld Psychiatry, 2019
- Prevalence and Incidence of Anxiety and Depression Among Children, Adolescents, and Young Adults With Life-Limiting ConditionsJAMA Pediatrics, 2019
- Effectiveness and Acceptability of Cognitive Behavior Therapy Delivery Formats in Adults With DepressionJAMA Psychiatry, 2019
- Efficacy of Self-guided Internet-Based Cognitive Behavioral Therapy in the Treatment of Depressive SymptomsJAMA Psychiatry, 2017
- Model‐Based Network Meta‐Analysis: A Framework for Evidence Synthesis of Clinical Trial DataCPT: Pharmacometrics & Systems Pharmacology, 2016
- Maximizing exposure therapy: An inhibitory learning approachBehaviour Research and Therapy, 2014
- The effects of psychotherapies for major depression in adults on remission, recovery and improvement: A meta-analysisJournal of Affective Disorders, 2014
- The empirical status of cognitive-behavioral therapy: A review of meta-analysesClinical Psychology Review, 2006