KHKristin M. Hawley

Kristin M. Hawley

*This is an algorithmically generated author record based on publicly available information.

Current Organizations / Institutes

The organizations/institutes from the scholar's latest article

Previous Organizations / Institutes

The organizations / institutes from the scholar's other articles in the past ten years


Kristin M. Hawley has a total of 105 co-authors. Here are the top co-authors by number of shared publications:


Latest Publications

  • The Youth-Focused Cognitive and Behavioral Therapy Adherence Measure: A Multi-Informant, Transdiagnostic, Trans-Manual, Adherence Monitoring Tool

    by Evelyn Cho, Jack H. Andrews, Rebecca Woo, Sarah Kate Bearman, Kristin M. Hawley

    While treatment adherence is often considered necessary for optimal clinical outcomes, adherence to evidence-based practices (EBPs) may be poorer in usual care (UC) than in research settings. Practical, accurate adherence monitoring tools may enhance EBP delivery in UC. We examined the psychometric properties of the Cognitive and Behavioral Therapy Adherence Measure (CBTAM), a multi-informant (provider, caregiver, youth) measure of provider adherence to the core components of cognitive and behavioral therapy (CBT) for youth anxiety, depression, and behavior problems. Providers (N = 28, M 29.46 years old; 75% female; 82.14% White; 7.40% Latinx), youths (N = 46, M 11.34 years old, 54.35% male; 58.70% White; 6.52% Latinx) and their caregivers (N = 41, M 42.63 years old; 92.68% female; 73.17% White; 9.76% Latinx) rated provider adherence to CBT following each treatment session. Coders rated a subset of treatment sessions using the CBTAM and established observational coding systems for CBT adherence and alliance. Provider, caregiver, and youth CBTAM ratings evidenced full range, but were generally higher than coder ratings. Caregivers and youths were concordant with coders on a few items, while providers were concordant on most items. Provider CBTAM ratings were also correlated with similar items on observational measures, and these correlations were higher than correlations with dissimilar items, demonstrating convergent and discriminant validity. There is initial support for the provider CBTAM as a session-level measure of CBT adherence for common youth mental health problems. Further research is needed to evaluate the CBTAM's reliability and clinical utility in community settings.

  • Mental Health Provider Reach and Engagement in a Countywide Training Initiative

    by Brigid R. Marriott, Jack H. Andrews, Evelyn Cho, Siena K. Tugendrajch, Kristin M. Hawley

    Many training initiatives are underway to increase implementation of evidence-based practice (EBPs) in mental healthcare. However, little is known about what types of trainings and supports yield the highest reach and engagement. Supported by a tax-funded, countywide initiative to improve access to quality care for youths, the current mixed methods study evaluates mental health (MH) provider reach, or registering for the training initiative, and engagement, or participation in training activities, for several EBP training and implementation supports. MH providers were offered free 1) formal EBP workshops, 2) a biweekly learning community, 3) individual case consultation, and 4) confidential online clinical feedback system. To register, interested providers (N = 698) completed a web-based assessment measuring clinical practice information, organizational implementation climate, and EBP knowledge, attitudes, and practices. Thirteen providers, selected via purposeful sampling stratified by level of participation, completed semi-structured qualitative interviews. While the training initiative achieved high reach (66% of county agencies had a provider register), far fewer providers engaged substantially in training. Quantitative results indicated that providers whose professional discipline was not psychology, had higher baseline EBP knowledge, more extensive use of common evidence-based strategies, and less extensive use of other therapy strategies, engaged in more training. Rapid qualitative analysis of interviews expanded upon these findings and illuminated provider, organizational, system, practical, and training activity-specific barriers and facilitators to engagement. Findings suggest the importance of identifying strategies for improving provider engagement in training activities beyond workshops. Implications for future research and training initiatives are discussed.


  • Commentary: Proactive and Responsive Integrated Primary Care Services to Meet the Needs of All Families

    by Jack H Andrews, Kristin M Hawley

    Integrated primary care (IPC) can play a critical role in preventing and minimizing impairment from behavioral health problems, but additional research is necessary to improve understanding of how to design and deliver pediatric IPC services that most effectively meet the needs of the U.S. population ( Lines & Riley, 2020; Stancin, 2016). Within this context, the work of Hails and colleagues (this issue) is a welcome and needed contribution. Their study, which examined determinants of parents’ attitudes toward various types of IPC services during the coronavirus disease 2019 (COVID-19) pandemic, has many strengths. These include the application of an evidence-informed theoretical model to guide study design and analyses, a diverse sample recruited from five clinics across three states, and the use of mixed methods to obtain deep understanding of parent perspectives. The authors provide a thoughtful discussion of the study’s findings in context of the COVID-19 pandemic and other societal-level sources of family stress.

  • A Structural Model of Organization and Clinician Factors Associated with Standardized Measure Use in a National Survey of Youth Mental Health Providers

    by Evelyn Cho, Jonathan R. Cook, Kristin M. Hawley

    Standardized assessment measures are important for accurate diagnosis of mental health problems and for treatment planning and evaluation. However, little is known about youth mental health providers’ typical use of standardized measures across disciplines and outside the context of evidence-based practice initiatives. A multidisciplinary national survey examined the frequency with which 674 youth mental health providers administer standardized and unstandardized measures, and the extent to which organizational (i.e., implementation climate, rigid hierarchical organizational structure) and provider (i.e., attitudes toward standardized assessment measures, highest degree, practice setting) characteristics are associated with standardized measure use. Providers used unstandardized measures far more frequently than standardized measures. Providers’ perceptions (a) that standardized measures are practical or feasible, (b) that their organization supports and values evidence-based practices, and (c) that their organization has a rigid hierarchical structure predicted greater use of standardized measures. Working in schools predicted less frequent SMU, while working in higher education and other professional settings predicted more frequent SMU. Standardized measures were not routinely used in this community-based sample. A rigid hierarchical organizational structure may be conducive to more frequent administration of standardized measures, but it is unclear whether such providers actually utilize these measures for clinical decision-making. Alternative strategies to promote standardized measure use may include promoting organizational cultures that value empirical data and encouraging use of standardized measures and training providers to use pragmatic standardized measures for clinical decision making.


  • Characterizing supervision-as-usual: Findings from two provider surveys.

    by Siena K. Tugendrajch, Evelyn Cho, Jack H. Andrews, Kristin M. Hawley

    Although clinical supervision is widely seen as critical for professional training and for safeguarding and promoting client well-being in mental health care, it is understudied, particularly in publicly funded services. In surveys of two large samples of youth mental health service providers (a state sample of providers billing Medicaid [N = 1,057] and a national sample of professional guild members [N = 1,720]), we examined the amount of time providers reported spending in supervision and consultation in a typical workweek and its covariation with characteristics of providers' caseloads and work settings. Across both samples, providers reported spending an average of 2-3 hr per week in supervision. Serving higher percentages of low-income clients was associated with significantly more supervision time. Working in private practice was associated with less supervision, while community mental health and residential facilities were each associated with more supervision time. The national survey also measured providers' perceptions of their current supervision. On average, providers endorsed feeling comfortable with the amount of supervision received and supported by their supervisors. However, working with more low-income clients was associated with greater need for supervisor approval and oversight and with less comfort in the amount of supervision received. Those working with more low-income clientele may benefit from additional supervision time or more focused supervision coverage of the specific needs of clients with low-income. More in-depth research on critical processes and content in supervision is a much-needed future direction for supervision research. (PsycInfo Database Record (c) 2023 APA, all rights reserved).


  • Implementation of a Low-Cost, Multi-component, Web-Based Training for Trauma-Focused Cognitive-Behavioral Therapy

    by Brigid R. Marriott, Matthew D. Kliethermes, J. Curtis McMillen, Enola K. Proctor, Kristin M. Hawley

    Effective, interactive trainings in evidence-based practices remain expensive and largely inaccessible to most practicing clinicians. To address this need, the current study evaluated the impact of a low-cost, multi-component, web-based training for Trauma-Focused Cognitive-Behavioral Therapy (TF-CBT) on clinicians’ TF-CBT knowledge, strategy use, adherence and skill. Clinician members of a practice-based research network were recruited via email and randomized to either an immediate training group (N = 89 assigned) or waitlist control group (N = 74 assigned) that was offered access to the same training after six months, with half of each group further randomized to receive or not receive incentives for participation. Clinicians completed assessments at baseline, 6 months, and 12 months covering TF-CBT knowledge, strategy use, and for a subset of clinicians (n = 28), TF-CBT adherence and skill. Although significant differences in overall TF-CBT skillfulness and readiness were found, there were no significant differences between the training and waitlist control group on TF-CBT knowledge and strategy use at six months. However, there was considerable variability in the extent of training completed by clinicians. Subsequent post-hoc analyses indicated a significant, positive association between the extent of training completed by clinicians and clinician TF-CBT knowledge, strategy use, demonstrated adherence and skill across the three TF-CBT components, and overall TF-CBT readiness. We also explored whether incentives predicted training participation and found no differences in training activity participation between clinicians who were offered an incentive and those who were not. Findings highlight the limitations of self-paced web-based trainings. Implications for web-based trainings are discussed.


  • Implementation of Evidence-Based Practices within Treatment-As-Usual and Evidence-Based Practice Initiatives

    by E. Cho, S. K. Tugendrajch, J. C. McMillen, E. K. Proctor, K. M. Hawley

    Publicly funded initiatives are underway to improve implementation of evidence-based practices (EBP) in youth mental health services. However, we know little about the success of these initiatives or about EBP implementation independent of such initiatives. We examined EBP implementation in a treatment as usual (TAU) state and in six states with publicly funded EBP initiatives (EBPIs). In Study 1, we examined providers’ use of practices derived from the evidence base (PDEB) and their predictors among 780 providers in a TAU state. In Study 2, we conducted a systematic review of implementation strategies, outcomes, and predictors of EBP use in six state funded EBPIs. Study 1 suggests TAU providers use PDEB alongside practices without consistent research support; provider racial/ethnic minority status, learning theory orientation, and manual use predict greater PDEB use. Study 2 indicates EBPIs employ multiple recommended implementation strategies with variable outcomes across studies and measurement approaches. Predictors of EBP use in EBPIs also varied, though training, setting, and youth age were consistent predictors across studies. While sample differences and inconsistent measurement across studies made direct comparisons somewhat tenuous, rates of PDEB use in the TAU sample appeared similar to those in publicly funded EBPIs. However, two states reported comparisons with TAU samples and found higher EBP implementation under EBPI. Different predictors impacted EBP use in TAU versus EBPIs. Our findings highlight the need for improved evaluation of EBPIs including clear reporting standards for outcomes and more consistent, standardized measurement of EBP use in order to better understand and improve EBPIs.


  • Measuring Evidence-Based Treatment Strategies in Youth Community Mental Health Care: the Evidence-Based Strategies Scale

    by Brigid R. Marriott, Evelyn Cho, Siena K. Tugendrajch, Kristin M. Hawley

    While there are established measures for fidelity to specific evidence-based treatments, there is no widely accepted, feasible measure of the use of evidence-based treatment strategies in youth mental health (MH) care. This study examined the factor structure of a provider self-report measure of evidence-based treatment strategy use, the Evidence-Based Strategies Scale (EBSS). MH providers completed the EBSS as part of a larger mailed survey. The factor structure of the EBSS was examined using exploratory factor analysis in a national, multidisciplinary sample of MH providers (N = 1092), and confirmatory factor analysis was subsequently conducted to replicate this factor structure in a state-wide, multidisciplinary sample of Medicaid MH providers (N = 780). Findings indicated a three-factor structure, representing working alliance, youth-focused, and family-focused evidence-based treatment strategies factors. The EBSS offers a potential method for measuring the evidence-based treatment strategies being delivered in youth community MH care, though more research is needed.


  • Open Access

    Assessing provider perceptions of training: Initial evaluation of the Acceptability, Feasibility, and Appropriateness Scale

    by Evelyn Cho, Aaron R. Lyon, Siena K. Tugendrajch, Brigid R. Marriott, Kristin M. Hawley

    There is a well-documented gap between research and practice in the treatment of mental health problems. One promising approach to bridging this gap is training community-based providers in evidence-based practices (EBPs). However, a paucity of valid, reliable measures to assess a range of outcomes of such trainings impedes our ability to evaluate and improve training toward this end. The current study examined the factor structure of the Acceptability, Feasibility, Appropriateness Scale (AFAS), a provider-report measure that assesses three perceptual implementation outcomes of trainings that may be leading indicators of training success (i.e., acceptability, feasibility, and appropriateness). Providers who attended half-day EBP trainings for common mental health problems reported on the acceptability, feasibility, and appropriateness of these trainings using the AFAS ( N = 298). Confirmatory factor analysis indicates good fit to the hypothesized three-factor structure (RMSEA = .058, CFI = .990, TLI = .987). Acceptability, feasibility, and appropriateness were three distinct but related constructs. Cronbach's alpha ranged from .86 to .91, indicating acceptable internal consistency for the three subscales. Acceptability and feasibility, but not appropriateness, scores varied between workshops, though variability across workshops was generally limited. This initial evaluation of the AFAS is in line with recent efforts to enhance psychometric reporting practices for implementation outcome measures and provides future directions for further development and refinement of the AFAS. Plain Language Summary: Clinician training in evidence-based practices is often used to increase implementation of evidence-based practices in mental health service settings. However, one barrier to evaluating the success of clinician trainings is the lack of measures that reliably and accurately assess clinician training outcomes. This study was the initial evaluation of the Acceptability, Feasibility, Appropriateness Scale (AFAS), a measure that assesses the immediate outcomes of clinician trainings. This study found some evidence supporting the AFAS reliability and its three subscales. With additional item refinement and psychometric testing, the AFAS could become a useful measure of a training's immediate impact on providers.