KWKelly Williams

Kelly Williams

*This is an algorithmically generated author record based on publicly available information.

Current Organizations / Institutes

The organizations/institutes from the scholar's latest article

Previous Organizations / Institutes

The organizations / institutes from the scholar's other articles in the past ten years


Kelly Williams has a total of 65 co-authors. Here are the top co-authors by number of shared publications:


Latest Publications

  • Open Access

    Feasibility and Acceptability of a Prevention-Focused Screener for Perinatal Depression Risk: Mixed Methods Cohort Study

    by Tamar Krishnamurti, Samantha Rodriguez, Leah Cope, Lara Lemon, Priya Gopalan, Cara Nikolajski, Hyagriv Simhan, Kelly Williams

    Background: More than 20% of perinatal women experience depression, with suicide being a leading cause of maternal death in the United States. Professional societies emphasize the need to identify those at risk of developing perinatal depression to better target preventive care delivery during pregnancy. Objective: We evaluated receptivity to a machine learning–based predictive screener designed to identify women in the first trimester of pregnancy who were asymptomatic but were at risk for developing moderate to severe depression symptoms later in pregnancy. Methods: Our participants were adult pregnant women with negative first-trimester depression (Patient Health Questionnaire–9) screens at 1 of 4 obstetric practices. Of the 810 women who were clinically eligible, 787 were successfully contacted via their patient portal. Of these, 289 (36.7%) viewed the screener and 255 (88.2%) completed the 6-question predictive screener. In total, 51 (20%) were identified by the screener as being at risk for developing perinatal depression. Participants were asked a series of follow-up questions regarding the acceptability of the predictive screener and desired preventive resources. Chi-square tests were used to compare demographic characteristics, perceived benefits and concerns, and desired resources between those identified as at risk for depression and those who were not. Differences in acceptability ratings between the two risk groups were determined using nonparametric Mann-Whitney U tests. Results: On a 5-point Likert scale of agreement, participants found the screener questions easy to complete (median score 5, IQR 5-5) and felt comfortable sharing their answers with their obstetric care providers (median 5, IQR 4-5). Key perceived benefits of completing the screener included opportunities to seek preventive care (75/255, 29.4%) and to receive education on depression risk (66/255, 25.9%). Primary concerns about knowing one’s risk of future depression included worrying about developing depression (90/255, 35.3%) and a lack of prevention opportunities (39/255, 15.3%). Desired preventive resources included counseling (197/255, 77.3%), mind-body interventions (166/255, 65.1%) such as exercise, and prenatal classes or support groups (81/255, 31.8%). Conclusions: Participants found the screener acceptable and felt comfortable receiving it through their patient portal. Specific preventive care options were commonly endorsed, several of which are scalable and evidence based. A minority of participants voiced addressable concerns about knowing their risk of developing depression in the future.

  • Integrated Care for Chronic Conditions: A Randomized Care Management Trial

    by Kelly Williams, Jane N. Kogan, Mid Sarah Markwardt, Chaeryon Kang, Doug Landsittel, Ellen Beckjord, Jordan F. Karp, DrPH Dan Swayze

    The authors sought to understand the differential impact of payer-led community-based care management approaches on stakeholder-oriented outcomes for publicly insured adults with multiple chronic conditions.

  • Open Access

    Design and methods of an adaptive trial to test comparative effectiveness of readmission reduction approaches following infection and sepsis hospitalizations (ACCOMPLISH)

    by Kristin Mayes, Victor B. Talisa, Adelina Malito, Florian B. Mayr, Kelly Williams, Kalpana Char, Richard Wadas, Elizabeth Lorenzi, Kert Viele, Rana Awdish, et al.


  • A Comparison of Delivery Modalities for Pregnancy Clinical Care Management

    by Kelly Williams, Mary Winger, Aisling LCSW McIntyre, Katie Msw Domalakes, Heidi Msc Stevenson, Natasha Khouri

    Objective: Given the high prevalence of maternal morbidity and mortality, it is imperative that maternal health interventions are comprehensively evaluated, so they can be scaled with fidelity. Community-based care management models focused on perinatal health care are a priority for health care systems and payers. Alternative care management delivery modalities, such as video visits, are needed to expand program reach amidst growing system-level challenges. This evaluation explores the feasibility, acceptability, and impact of video versus telephonic care in perinatal care management. Methods: Using a mixed methods approach, we implemented a quality improvement project to learn about the integration and impact of video-enabled care into the UPMC Health Plan “Pregnancy Clinical Support” (PCS) care management delivery model. Focus groups were conducted with PCS care managers (CMs) to explore their perspectives on video-visit integration. Video-only members were propensity scores matched to telephonic-only members; statistical comparisons were conducted to assess between-group differences in engagement. Results: PCS CMs discussed ways to structure effective video-visit onboarding, strengths, and drawbacks of video-enabled care, workflow integration challenges, and best practices for introducing video visits to members. Video-only members had significantly (P < 0.0001) more clinical sessions (2.56 ± 1.57 vs 2.05 ± 1.52) and longer case duration measured in calendar days (209 ± 80 vs 169 ± 94) during the 17-month project period than telephonic-only members. Conclusion: Evidence generated provides direct guidance on successfully integrating video visits into workflows of community-based CMs while improving engagement in care across diverse member populations.

  • Identifying High-Need, High-Cost Patients: A Real-World Perspective

    by Lucy A. Savitz, Kelly Rice Williams, Dan Swayze

    Berkman and colleagues used a novel technique to update an existing framework for identifying high-need, high-cost patients. The editorialists offer a real-world perspective on how the modified fra...

  • Open Access

    Health Care Provider Perspectives on the Use of a Digital Behavioral Health App to Support Patients: Qualitative Study

    by Valerie Silfee, Kelly Williams, Brett Leber, Jane Kogan, Cara Nikolajski, Eva Szigethy, Catherine Serio

    Background: Despite the growing evidence indicating the efficacy of digital cognitive behavioral interventions (dCBIs) for behavioral health (BH) treatment, broad and consistent use of such interventions has been limited by knowledge obtained in real-world settings, including factors that impact provider uptake/referral. Engaging providers early in the implementation process offers an opportunity to explore their needs and behaviors, integrate interventions into workflows, and better understand provider setting capabilities. Objective: This study assessed providers’ views on the feasibility and acceptability of delivering a cognitive behavioral therapy (CBT)-based mobile app in multiple care settings. Methods: Participating providers included BH and physical health (PH) providers from a women’s health center, an outpatient BH clinic, and both rural/urban primary care settings. All participating providers cocreated workflows through facilitated workshops, including establishing feedback loops between the project team and providers and identifying clinical champions at each site. Over a 12-week period, the providers referred adult patients experiencing anxiety or depression to a mobile app-based dCBI, RxWell, and provided other indicated treatments as part of usual care. Referrals were completed by the providers through the electronic medical record. To better understand facilitators of and challenges in integrating RxWell into routine practice and perceptions of sustainability, a series of qualitative interviews was conducted. Interview data were analyzed to identify major themes using an inductive content analysis approach. Results: A total of 19 provider interviews were conducted to discover motivators and barriers for referring RxWell. The providers benefited from a focused discussion on how to incorporate the referral process into their workflow, and knowing the app content was rooted in evidence. Although the providers believed engaging in experiential learning was important, they indicated that more education on the digital health coach role and how to monitor patient progress is needed. The providers thought patient engagement may be impacted by motivation, a lack of comfort using a smartphone, or preference for in-person therapy. The providers also expressed enthusiasm in continuing to refer the app. They liked the ability to provide patients with support between sessions, to have an extra treatment option that teaches BH exercises, and to have a CBT treatment option that overcomes barriers (eg, wait times, copays, travel) to traditional therapy modalities. Conclusions: Digital intervention success in health care settings relies heavily on engagement of key stakeholders, such as providers, in both design and implementation of the intervention and focused evaluation within intended care setting(s). Scaling digital interventions to meet the mental health needs of patients in usual care settings leans on thoughtfully constructed and streamlined workflows to enable seamless referral of patients by providers. Our findings strongly suggest that providers are supportive of digital tool integration to support the mental health of patients and endorse its use within their routine workflow.


  • Open Access

    Health Care Provider Perspectives on the Use of a Digital Behavioral Health App to Support Patients: Qualitative Study (Preprint)

    by Valerie Silfee, Kelly Williams, Brett Leber, Jane Kogan, Cara Nikolajski, Eva Szigethy, Catherine Serio

    BACKGROUND Despite the growing evidence indicating the efficacy of digital cognitive behavioral interventions (dCBIs) for behavioral health (BH) treatment, broad and consistent use of such interventions has been limited by knowledge obtained in real-world settings, including factors that impact provider uptake/referral. Engaging providers early in the implementation process offers an opportunity to explore their needs and behaviors, integrate interventions into workflows, and better understand provider setting capabilities. OBJECTIVE This study assessed providers’ views on the feasibility and acceptability of delivering a cognitive behavioral therapy (CBT)-based mobile app in multiple care settings. METHODS Participating providers included BH and physical health (PH) providers from a women’s health center, an outpatient BH clinic, and both rural/urban primary care settings. All participating providers cocreated workflows through facilitated workshops, including establishing feedback loops between the project team and providers and identifying clinical champions at each site. Over a 12-week period, the providers referred adult patients experiencing anxiety or depression to a mobile app-based dCBI, RxWell, and provided other indicated treatments as part of usual care. Referrals were completed by the providers through the electronic medical record. To better understand facilitators of and challenges in integrating RxWell into routine practice and perceptions of sustainability, a series of qualitative interviews was conducted. Interview data were analyzed to identify major themes using an inductive content analysis approach. RESULTS A total of 19 provider interviews were conducted to discover motivators and barriers for referring RxWell. The providers benefited from a focused discussion on how to incorporate the referral process into their workflow, and knowing the app content was rooted in evidence. Although the providers believed engaging in experiential learning was important, they indicated that more education on the digital health coach role and how to monitor patient progress is needed. The providers thought patient engagement may be impacted by motivation, a lack of comfort using a smartphone, or preference for in-person therapy. The providers also expressed enthusiasm in continuing to refer the app. They liked the ability to provide patients with support between sessions, to have an extra treatment option that teaches BH exercises, and to have a CBT treatment option that overcomes barriers (eg, wait times, copays, travel) to traditional therapy modalities. CONCLUSIONS Digital intervention success in health care settings relies heavily on engagement of key stakeholders, such as providers, in both design and implementation of the intervention and focused evaluation within intended care setting(s). Scaling digital interventions to meet the mental health needs of patients in usual care settings leans on thoughtfully constructed and streamlined workflows to enable seamless referral of patients by providers. Our findings strongly suggest that providers are supportive of digital tool integration to support the mental health of patients and endorse its use within their routine workflow.

  • Open Access

    Correction: Addressing Implementation Challenges to Digital Care Delivery for Adults With Multiple Chronic Conditions: Stakeholder Feedback in a Randomized Controlled Trial

    by Kelly Williams, Sarah Markwardt, Shannon M Kearney, Jordan F Karp, Kevin L Kraemer, Margaret J Park, Paul Freund, Andrew Watson, James Schuster, Ellen Beckjord

    [This corrects the article DOI: 10.2196/23498.].


  • Open Access

    Correction: Addressing Implementation Challenges to Digital Care Delivery for Adults With Multiple Chronic Conditions: Stakeholder Feedback in a Randomized Controlled Trial (Preprint)

    by Kelly Williams, Sarah Markwardt, Shannon M Kearney, Jordan F Karp, Kevin L Kraemer, Margaret J Park, Paul Freund, Andrew Watson, James Schuster, Ellen Beckjord

    Journal of Medical Internet Research - International Scientific Journal for Medical Research, Information and Communication on the Internet #Preprint #PeerReviewMe: Warning: This is a unreviewed preprint. Readers are warned that the document has not been peer-reviewed by expert/patient reviewers or an academic editor, may contain misleading claims, and is likely to undergo changes before final publication, if accepted, or may have been rejected/withdrawn. Readers with interest and expertise are encouraged to sign up as peer-reviewer, if the paper is within an open peer-review period. Please cite this preprint only for review purposes or for grant applications and CVs (if you are the author).

  • Open Access

    Addressing Implementation Challenges to Digital Care Delivery for Adults With Multiple Chronic Conditions: Stakeholder Feedback in a Randomized Controlled Trial

    by Kelly Williams, Sarah Markwardt, Shannon M Kearney, Jordan F Karp, Kevin L Kraemer, Margaret J Park, Paul Freund, Andrew Watson, James Schuster, Ellen Beckjord

    Background: Digital tools accessed via smartphones can promote chronic condition management, reduce disparities in health care and hospital readmissions, and improve quality of life. However, whether digital care strategies can be implemented successfully on a large scale with traditionally underserved populations remains uncertain. Objective: As part of a randomized trial comparing care delivery strategies for Medicaid and Medicare-Medicaid beneficiaries with multiple chronic conditions, our stakeholders identified implementation challenges, and we developed stakeholder-driven adaptions to improve a digitally delivered care management strategy (high-tech care). Methods: We used 4 mechanisms (study support log, Patient Partners Work Group log, case interview log, and implementation meeting minutes) to capture stakeholder feedback about technology-related challenges and solutions from 9 patient partners, 129 participants, and 32 care managers and used these data to develop and implement solutions. To assess the impact, we analyzed high-tech care exit surveys and intervention engagement outcomes (video visits and condition-specific text message check-ins sent at varying intervals) before and after each solution was implemented. Results: Challenges centered around 2 themes: difficulty using both smartphones and high-tech care components and difficulty using high-tech care components due to connectivity issues. To respond to the first theme’s challenges, we devised 3 solutions: tech visits (eg, in-person technology support visits), tech packet (eg, participant-facing technology user guide), and tailored condition-specific text message check-ins. During the first 20 months of implementation, 73 participants received at least one tech visit. We observed a 15% increase in video call completion for participants with data before and after the tech visit (n=25) and a 7% increase in check-in completion for participants with data before and after the tech visit (n=59). Of the 379 participants given a tech packet, 179 completed care during this timeframe and were eligible for an exit survey. Of the survey respondents, 76% (73/96) found the tech packet helpful and 64% (62/96) actively used it during care. To support condition-specific text message check-in completion, we allowed for adaption of day and/or time of the text message with 31 participants changing the time they received check-ins and change in standard biometric settings with 13 physicians requesting personalized settings for participants. To respond to the second theme’s challenges, tech visits or phone calls were made to demonstrate how to use a smartphone to connect or disconnect from the internet, to schedule video calls, or for condition-specific text message check-ins in a location with broadband/internet. Conclusions: Having structured stakeholder feedback mechanisms is key to identify challenges and solutions to digital care engagement. Creating flexible and scalable solutions to technology-related challenges will increase equity in accessing digital care and support more effective engagement of chronically ill populations in the use of these digital care tools. Trial Registration: ClinicalTrials.gov NCT03451630; https://clinicaltrials.gov/ct2/show/NCT03451630.