Identifying Quality Indicators in Children’s Mental Health Services: Identifying Evidence-Based Practice (EBP) Content Associated with Caregiver-Reported Child Mental Health Trajectories
Authors:
Open Access
- 10 June 2026
- journal article
- Published by Springer Nature in Administration and Policy in Mental Health and Mental Health Services Research
Abstract
Despite efforts to characterize the psychotherapeutic strategies used in routine children’s mental health services and develop pragmatic assessments of evidence-based practice (EBP) strategy delivery, research on the associations between EBP strategies and child outcomes is very limited. The Evidence-based Concordant Care Assessment (ECCA; Brookman-Frazee et al., 2021) is a measure designed to assess therapist delivery of evidence-based strategies in children’s mental health services. Previous research on the predictive validity of the ECCA indicates that a subset of ECCA Technique strategies are associated with child mental health outcome trajectories across presenting problems. The current study extends analyses to identify ECCA Content strategies associated with caregiver-reported outcome trajectories for children with specific presenting problems, and for distinct age groups. Data were obtained from 1,380 sessions with 248 children being served by 76 therapists in two county systems. Child primary presenting problems included: depression (32%), externalizing problems (27%), anxiety (22%), trauma (14%), and other concerns (5%). Children were, on average, 11.8 years old ( SD = 3.7). Therapists reported their delivery of EBP strategies at the session-level using the ECCA (Brookman-Frazee et al., 2021) which includes 25 Content strategies (e.g., Time-Out , Cognitive Restructuring ). Caregivers reported symptoms on the Brief Problem Checklist (BPC; Chorpita et al., 2010) at baseline, weekly over two months of treatment, and again at four months. Multilevel models examined whether the frequency and/or the extensiveness of ECCA Content strategy use were associated with child outcome trajectories in subgroup analyses by primary presenting problem and age group. Fourteen ECCA Content strategies were significantly associated with decline in child symptoms for at least one presenting problem, and/or age group. Specifically, delivery of Cognitive Restructuring was significantly associated with symptom improvement in the full sample, and for subgoups including externalizing, trauma, and depression subgroups. Additional Content strategies were associated with outcomes for specific subgroups: Following the Child’s Lead , Praise , and Differential Reinforcement for 8–12 year olds, Distracting & Redirecting for externalizing, depression, and 8–12 year olds; Timeout for depression; Behavioral Contracting for depression; Exposure for trauma; Relaxation for trauma, Youth Education Support/Activities for trauma; Assertiveness training for externalizing, and Safety Skills for trauma. The ECCA study is the first to demonstrate the associations between therapist reported use of individual EBP strategies and child outcomes within children’s mental health services. The findings support the potential of scalable therapist reports of EBP content delivery as a pragmatic quality indicator in systems of care.Keywords
Funding Information
- National Institute of Mental Health (R01MH112536)
- National Institute of Mental Health (K23MH123067)
- National Institute of Mental Health (R01MH112536)
This publication has 22 references indexed in Scilit:
- A Comparison of Pragmatic and Scalable Strategies to Assess Fidelity to Cognitive Processing Therapy in Routine Care SettingsBehavior Therapy, 2024
- Validating a Pragmatic Measure of Evidence-Based Practice (EBP) Delivery: Therapist Reports of EBP Strategy Delivery and Associations with Child Outcome TrajectoriesAdministration and Policy in Mental Health and Mental Health Services Research, 2024
- The Content of Usual Clinical Care for Youth with Primary Anxiety ProblemsAdministration and Policy in Mental Health and Mental Health Services Research, 2024
- Therapist Self-Report of Fidelity to Core Elements of Family Therapy for Adolescent Behavior Problems: Psychometrics of a Pragmatic Quality Indicator ToolAdministration and Policy in Mental Health and Mental Health Services Research, 2021
- Therapist-Observer Concordance in Ratings of EBP Strategy Delivery: Challenges and Targeted Directions in Pursuing Pragmatic Measurement in Children’s Mental Health ServicesAdministration and Policy in Mental Health and Mental Health Services Research, 2021
- Monitoring Fidelity to an Evidence-Based Treatment: Practitioner PerspectivesClinical Social Work Journal, 2017
- Validity of Clinician’s Self-Reported Practice Elements on the Monthly Treatment and Progress SummaryThe Journal of Behavioral Health Services & Research, 2013
- Pragmatic MeasuresAmerican Journal of Preventive Medicine, 2013
- Toward the Effective and Efficient Measurement of Implementation FidelityAdministration and Policy in Mental Health and Mental Health Services Research, 2010
- Exploring the Black Box: Measuring Youth Treatment Process and Progress in Usual CareAdministration and Policy in Mental Health and Mental Health Services Research, 2010