HWHattie Wilczewski

Hattie Wilczewski

*This is an algorithmically generated author record based on publicly available information.

Hattie Wilczewski has a total of 36 co-authors. Here are the top co-authors by number of shared publications:


Latest Publications

  • Open Access

    Psychiatrists’ Perceptions of Unedited AI-Generated SOAP Notes: An Exploratory Mixed-Methods Quality Evaluation (Preprint)

    by Grace Crisp, Hiral Soni, Christopher Pelic, Julia Ivanova, Hattie Wilczewski, Paul M. Heider, Jordon Ritchie, Xia Jing, Brandon Welch

    BACKGROUND Documentation burden is a major contributor to physician burnout, and AI-assisted documentation tools have emerged as a potential solution. While early evidence suggests these tools reduce documentation time in medical settings, psychiatry presents distinct challenges, as notes capture sensitive information about mental states, suicidal ideation, and psychosocial circumstances. These tools are already entering clinical use, yet the quality of AI-generated documentation has not been thoroughly evaluated in psychiatry. To our knowledge, no prior study has examined psychiatrists' perceptions of the quality of AI-generated psychiatric SOAP (Subjective, Objective, Assessment, and Plan) notes. OBJECTIVE We aimed to understand in detail how psychiatrists perceive the quality of unedited AI-generated SOAP notes using a controlled design, focusing on six notes generated by three frontier large language models for a single simulated telehealth encounter. METHODS We conducted a prospective, mixed-methods exploratory study in which 12 US-based, board-certified or board-eligible psychiatrists evaluated six AI-generated SOAP notes about a single simulated psychiatric telehealth encounter. The notes were generated by three frontier LLMs (OpenAI GPT-5, Anthropic Claude Sonnet 4, and Google Gemini 2.5 Pro) from the session transcript using an identical prompt. Evaluators watched the session recording, then rated each note on the 10-attribute Modified Physician Documentation Quality Instrument, which has been used in other AI-generated clinical note quality studies. We also collected written rationales for each attribute rating and an overall comment for each note. Finally, evaluators completed a post-evaluation survey. Rationales and survey responses were analyzed using content and thematic analysis. Note ratings and coded qualitative data were analyzed together to understand psychiatrists’ perceptions. We also assessed agreement among evaluators using intraclass correlation coefficients and Kendall’s coefficient of concordance. RESULTS Across 72 evaluations (12 evaluators x 6 notes), notes received a mean total score of 42 of 50 (median 42, IQR 39-46). Despite favorable ratings, written rationales revealed concerns of verbosity, factual errors and hallucinations (including two notes with incorrect session durations), and issues with the mental status exam sections. We found that highly rated notes contained errors that may be consequential if not caught during review, and not all evaluators caught notable errors in the notes in this study. While the notes were not perfect, evaluators simultaneously praised their usefulness and thoroughness. Interestingly, inter-evaluator agreement on total scores was poor (ICC=0.04), and agreement on the individual quality attributes was similarly low, ranging from -0.04 to 0.17. Analysis of variance components revealed that variance was attributed more to differences among evaluators than differences among the notes, which may indicate differences in opinion among psychiatrists as to what constitutes quality documentation. Comments revealed similar differences across evaluators. CONCLUSIONS The AI-generated notes in this study were perceived favorably by psychiatrists, who highlighted their usefulness and acknowledged their imperfections. Psychiatrists showed little agreement with one another about which notes were better and qualitative data revealed they prioritized different aspects of the notes in their comments. While our specific findings are not generalizable, they do underscore the perceived usefulness of AI-generated notes in psychiatry, as well as the necessity for thorough review before signing them.

  • Open Access

    Mental Health Care Guidelines for Telemedicine During the COVID-19 Pandemic: Scoping Review

    by Julia Ivanova, Triton Ong, Hattie Wilczewski, Mollie Cummins, Hiral Soni, Janelle Barrera, Brandon Welch, Brian Bunnell

    Background: Mental health care providers have widely adopted telemedicine since the onset of the COVID-19 pandemic. Some providers have reported difficulties in implementing telemedicine and are still assessing its sustainability for their practices. Recommendations, best practices, and guidelines for telemedicine-based mental health care (ie, telemental health care [TMH]) have been published, but the nature and extent of this guidance have not been assessed. Objective: We aimed to determine (1) the form of TMH guidelines and recommendations presented to providers, (2) the most commonly presented recommendations and guidelines, and (3) the perceived benefits and challenges of these TMH guidelines and recommendations. Methods: Through our scoping review of practice guidelines, we aimed to identify themes in TMH guidelines and clinical recommendations published between 2020 and 2024 in peer-reviewed journals. This review focused on the first 2 years of the COVID-19 pandemic to identify and characterize the available TMH guidance. We searched PubMed/MEDLINE and ScienceDirect for articles in peer-reviewed journals published between January 1, 2020, and July 16, 2024. We included articles that were available in English and presented recommendations, best practices, or guidelines for TMH. We excluded duplicates, articles unrelated to telehealth, brief editorial introductions, and those not publicly available. We applied the Healthcare Provider Taxonomy of the National Uniform Claim Committee to article titles and abstracts to identify records relevant to mental health. We used content and thematic analyses to identify key themes. Results: Of the 1348 articles retrieved, we identified 76 that matched our criteria. Through content and thematic analyses, we identified 3 main themes—along with subthemes and topics—related to Facilitators, Concerns, and Changes Advised. The majority of articles called for further research (59/76) and for telemental health education and innovation in some form (43/76) regarding advised changes. Twenty-four articles included specific guidelines, recommendations, or checklists for providers. Conclusions: The results highlight the need for further large-scale research to support the development of effective guidelines and protocols for therapy plans. Although TMH care is widespread, scholarly work emphasizes the need for a stronger evidence base that includes testing protocols in diverse settings and populations. The results also underscore the importance of increasing health professionals’ knowledge of regulatory compliance and providing them with adequate TMH practice education.


  • Open Access

    Regulation and Compliance in Telemedicine: Viewpoint

    by Julia Ivanova, Mollie R Cummins, Triton Ong, Hiral Soni, Janelle Barrera, Hattie Wilczewski, Brandon Welch, Brian Bunnell

    The US COVID-19 Public Health Emergency ended on May 11, 2023. Lawmakers and regulators extended some flexibilities while they deliberate effective long-term telemedicine policy. Here, we discuss critical challenges in telemedicine compliance and regulation grounded in scholarly literature and current events. We specifically consider obstacles and progress toward solutions in telemedicine law and regulation regarding privacy and security issues, care across state borders, and prescribing over telemedicine in the United States. We conclude that simplified policies are needed to keep telemedicine accessible to providers and patients and that current privacy and security measures need refinement to protect patients appropriately.


  • Open Access

    Patient Preferences for Direct-to-Consumer Telemedicine Services: Replication and Extension of a Nationwide Survey

    by Julia Ivanova, Hattie Wilczewski, Farina Klocksieben, Mollie Cummins, Hiral Soni, Triton Ong, Janelle Barrera, Jillian Harvey, Nathaniel O'COnnell, James McElligott, et al.

    Background: A 2017 survey of patient perspectives showed overall willingness and comfort to use telemedicine, but low actual use. Given recent growth and widespread exposure of patients to telemedicine, patient preferences are likely to have changed. Objective: This study aimed to (1) identify demographic trends in patient preferences and experiences; (2) measure ease of use and satisfaction of telemedicine; and (3) measure changes in telemedicine use, willingness, and comfort since 2017. Methods: We replicated a 2017 study with a nationwide survey of US adults. The survey, an extended version of the previous study, measured patient health care access as well as knowledge, experiences, and preferences regarding telemedicine encounters. We recruited participants using SurveyMonkey Audience in July 2022. We used descriptive statistics and generalized estimating equations to measure change and identify trends. Results: We accrued 4577 complete responses. Patient experience with telemedicine was substantially higher in 2022 than in 2017, with 61.1% (vs 5.3%) of participants aware that their primary care provider offered telemedicine and 34.5% (vs 3.5%) reporting use of telemedicine with their primary care provider. This study also reported ease of use and satisfaction rates to be similar to in-person visits, while overall willingness and comfort in using telemedicine increased from 2017. Individuals at the poverty line were significantly less likely to report satisfaction with telemedicine visits. We found increased interpersonal distance in a patient and health care professional relationship significantly reduced patient ease of use, willingness, and comfort in using telemedicine. Conclusions: This study identified an association between income and patient satisfaction, conveying the importance of understanding telemedicine in relation to health care access and equity. Telemedicine ease of use and satisfaction were comparable to in-person visits. Individuals reported greater use and higher positive perceptions of telemedicine willingness and comfort since 2017.


  • Open Access

    User Preferences and Needs for Health Data Collection Using Research Electronic Data Capture: Survey Study

    by Hiral Soni, Julia Ivanova, Hattie Wilczewski, Triton Ong, J Nalubega Ross, Alexandra Bailey, Mollie Cummins, Janelle Barrera, Brian Bunnell, Brandon Welch

    Background: Self-administered web-based questionnaires are widely used to collect health data from patients and clinical research participants. REDCap (Research Electronic Data Capture; Vanderbilt University) is a global, secure web application for building and managing electronic data capture. Unfortunately, stakeholder needs and preferences of electronic data collection via REDCap have rarely been studied. Objective: This study aims to survey REDCap researchers and administrators to assess their experience with REDCap, especially their perspectives on the advantages, challenges, and suggestions for the enhancement of REDCap as a data collection tool. Methods: We conducted a web-based survey with representatives of REDCap member organizations in the United States. The survey captured information on respondent demographics, quality of patient-reported data collected via REDCap, patient experience of data collection with REDCap, and open-ended questions focusing on the advantages, challenges, and suggestions to enhance REDCap’s data collection experience. Descriptive and inferential analysis measures were used to analyze quantitative data. Thematic analysis was used to analyze open-ended responses focusing on the advantages, disadvantages, and enhancements in data collection experience. Results: A total of 207 respondents completed the survey. Respondents strongly agreed or agreed that the data collected via REDCap are accurate (188/207, 90.8%), reliable (182/207, 87.9%), and complete (166/207, 80.2%). More than half of respondents strongly agreed or agreed that patients find REDCap easy to use (165/207, 79.7%), could successfully complete tasks without help (151/207, 72.9%), and could do so in a timely manner (163/207, 78.7%). Thematic analysis of open-ended responses yielded 8 major themes: survey development, user experience, survey distribution, survey results, training and support, technology, security, and platform features. The user experience category included more than half of the advantage codes (307/594, 51.7% of codes); meanwhile, respondents reported higher challenges in survey development (169/516, 32.8% of codes), also suggesting the highest enhancement suggestions for the category (162/439, 36.9% of codes). Conclusions: Respondents indicated that REDCap is a valued, low-cost, secure resource for clinical research data collection. REDCap’s data collection experience was generally positive among clinical research and care staff members and patients. However, with the advancements in data collection technologies and the availability of modern, intuitive, and mobile-friendly data collection interfaces, there is a critical opportunity to enhance the REDCap experience to meet the needs of researchers and patients.


  • Open Access

    Travel Distance Between Participants in US Telemedicine Sessions With Estimates of Emissions Savings: Observational Study

    by Mollie R Cummins, Sukrut Shishupal, Bob Wong, Neng Wan, Jiuying Han, Jace D Johnny, Amy Mhatre-Owens, Ramkiran Gouripeddi, Julia Ivanova, Triton Ong, et al.

    Background: Digital health and telemedicine are potentially important strategies to decrease health care’s environmental impact and contribution to climate change by reducing transportation-related air pollution and greenhouse gas emissions. However, we currently lack robust national estimates of emissions savings attributable to telemedicine. Objective: This study aimed to (1) determine the travel distance between participants in US telemedicine sessions and (2) estimate the net reduction in carbon dioxide (CO2) emissions attributable to telemedicine in the United States, based on national observational data describing the geographical characteristics of telemedicine session participants. Methods: We conducted a retrospective observational study of telemedicine sessions in the United States between January 1, 2022, and February 21, 2023, on the doxy.me platform. Using Google Distance Matrix, we determined the median travel distance between participating providers and patients for a proportional sample of sessions. Further, based on the best available public data, we estimated the total annual emissions costs and savings attributable to telemedicine in the United States. Results: The median round trip travel distance between patients and providers was 49 (IQR 21-145) miles. The median CO2 emissions savings per telemedicine session was 20 (IQR 8-59) kg CO2). Accounting for the energy costs of telemedicine and US transportation patterns, among other factors, we estimate that the use of telemedicine in the United States during the years 2021-2022 resulted in approximate annual CO2 emissions savings of 1,443,800 metric tons. Conclusions: These estimates of travel distance and telemedicine-associated CO2 emissions costs and savings, based on national data, indicate that telemedicine may be an important strategy in reducing the health care sector’s carbon footprint.


  • Open Access

    Therapist perspectives on telehealth-based virtual reality exposure therapy

    by Triton Ong, Julia Ivanova, Hiral Soni, Hattie Wilczewski, Janelle Barrera, Mollie Cummins, Brandon M. Welch, Brian E. Bunnell

    Virtual reality (VR) can enhance mental health care. In particular, the effectiveness of VR-based exposure therapy (VRET) has been well-demonstrated for treatment of anxiety disorders. However, most applications of VRET remain localized to clinic spaces. We aimed to explore mental health therapists’ perceptions of telehealth-based VRET (tele-VRET) by conducting semi-structured, qualitative interviews with 18 telemental health therapists between October and December 2022. Interview topics included telehealth experiences, exposure therapy over telehealth, previous experiences with VR, and perspectives on tele-VRET. Therapists described how telehealth reduced barriers (88.9%, 16/18), enhanced therapy (61.1%, 11/18), and improved access to clients (38.9%, 7/18), but entailed problems with technology (61.1%, 11/18), uncontrolled settings (55.6%, 10/18), and communication difficulties (50%, 9/18). Therapists adapted exposure therapy to telehealth by using online resources (66.7%, 12/18), preparing client expectations (55.6%, 10/18), and adjusting workflows (27.8%, 5/18). Most therapists had used VR before (72.2%, 13/18) and had positive impressions of VR (55.6%, 10/18), but none had used VR clinically. In response to tele-VRET, therapists requested interactive session activities (77.8%, 14/18) and customizable interventions components (55.6%, 10/18). Concerns about tele-VRET included risks with certain clients (77.8%, 14/18), costs (50%, 9/18), side effects and privacy (22.2%, 4/18), and inappropriateness for specific forms of exposure therapy (16.7%, 3/18). These results reveal how combining telehealth and VRET may expand therapeutic options for mental healthcare providers and can help inform collaborative development of immersive health technologies.


  • Open Access

    Mental Health Care Guidelines for Telemedicine During the COVID-19 Pandemic: Scoping Review (Preprint)

    by Julia Ivanova, Triton Ong, Hattie Wilczewski, Mollie Cummins, Hiral Soni, Janelle Barrera, Brandon Welch, Brian Bunnell

    BACKGROUND Mental health care providers have widely adopted telemedicine since the onset of the COVID-19 pandemic. Some providers have reported difficulties in implementing telemedicine and are still assessing its sustainability for their practices. Recommendations, best practices, and guidelines for telemedicine-based mental health care (ie, telemental health care [TMH]) have been published, but the nature and extent of this guidance have not been assessed. OBJECTIVE We aimed to determine (1) the form of TMH guidelines and recommendations presented to providers, (2) the most commonly presented recommendations and guidelines, and (3) the perceived benefits and challenges of these TMH guidelines and recommendations. METHODS Through our scoping review of practice guidelines, we aimed to identify themes in TMH guidelines and clinical recommendations published between 2020 and 2024 in peer-reviewed journals. This review focused on the first 2 years of the COVID-19 pandemic to identify and characterize the available TMH guidance. We searched PubMed/MEDLINE and ScienceDirect for articles in peer-reviewed journals published between January 1, 2020, and July 16, 2024. We included articles that were available in English and presented recommendations, best practices, or guidelines for TMH. We excluded duplicates, articles unrelated to telehealth, brief editorial introductions, and those not publicly available. We applied the Healthcare Provider Taxonomy of the National Uniform Claim Committee to article titles and abstracts to identify records relevant to mental health. We used content and thematic analyses to identify key themes. RESULTS Of the 1348 articles retrieved, we identified 76 that matched our criteria. Through content and thematic analyses, we identified 3 main themes—along with subthemes and topics—related to Facilitators, Concerns, and Changes Advised. The majority of articles called for further research (59/76) and for telemental health education and innovation in some form (43/76) regarding advised changes. Twenty-four articles included specific guidelines, recommendations, or checklists for providers. CONCLUSIONS The results highlight the need for further large-scale research to support the development of effective guidelines and protocols for therapy plans. Although TMH care is widespread, scholarly work emphasizes the need for a stronger evidence base that includes testing protocols in diverse settings and populations. The results also underscore the importance of increasing health professionals’ knowledge of regulatory compliance and providing them with adequate TMH practice education.


  • Open Access

    Regulation and Compliance in Telemedicine: Viewpoint (Preprint)

    by Julia Ivanova, Mollie R Cummins, Triton Ong, Hiral Soni, Janelle Barrera, Hattie Wilczewski, Brandon Welch, Brian Bunnell

    UNSTRUCTURED The US COVID-19 Public Health Emergency ended on May 11, 2023. Lawmakers and regulators extended some flexibilities while they deliberate effective long-term telemedicine policy. Here, we discuss critical challenges in telemedicine compliance and regulation grounded in scholarly literature and current events. We specifically consider obstacles and progress toward solutions in telemedicine law and regulation regarding privacy and security issues, care across state borders, and prescribing over telemedicine in the United States. We conclude that simplified policies are needed to keep telemedicine accessible to providers and patients and that current privacy and security measures need refinement to protect patients appropriately.

  • Open Access

    Travel Distance Between Participants in US Telemedicine Sessions With Estimates of Emissions Savings: Observational Study (Preprint)

    by Mollie R Cummins, Sukrut Shishupal, Bob Wong, Neng Wan, Jiuying Han, Jace D Johnny, Amy Mhatre-Owens, Ramkiran Gouripeddi, Julia Ivanova, Triton Ong, et al.

    BACKGROUND Digital health and telemedicine are potentially important strategies to decrease health care’s environmental impact and contribution to climate change by reducing transportation-related air pollution and greenhouse gas emissions. However, we currently lack robust national estimates of emissions savings attributable to telemedicine. OBJECTIVE This study aimed to (1) determine the travel distance between participants in US telemedicine sessions and (2) estimate the net reduction in carbon dioxide (CO2) emissions attributable to telemedicine in the United States, based on national observational data describing the geographical characteristics of telemedicine session participants. METHODS We conducted a retrospective observational study of telemedicine sessions in the United States between January 1, 2022, and February 21, 2023, on the doxy.me platform. Using Google Distance Matrix, we determined the median travel distance between participating providers and patients for a proportional sample of sessions. Further, based on the best available public data, we estimated the total annual emissions costs and savings attributable to telemedicine in the United States. RESULTS The median round trip travel distance between patients and providers was 49 (IQR 21-145) miles. The median CO2 emissions savings per telemedicine session was 20 (IQR 8-59) kg CO2). Accounting for the energy costs of telemedicine and US transportation patterns, among other factors, we estimate that the use of telemedicine in the United States during the years 2021-2022 resulted in approximate annual CO2 emissions savings of 1,443,800 metric tons. CONCLUSIONS These estimates of travel distance and telemedicine-associated CO2 emissions costs and savings, based on national data, indicate that telemedicine may be an important strategy in reducing the health care sector’s carbon footprint.