Zhiyong Dong
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Research Subjects
Research Interests
Zhiyong Dong has a total of 52 co-authors. Here are the top co-authors by number of shared publications:
- Catherine M. DesRoches
Harvard Medical School, Open Notes Labs, Beth Israel Deaconess Medical Center , Boston, MA 02215, United States
8 shared publications - Jan Walker
Division of General Medicine, Beth Israel Deaconess Medical Center, Boston, MA, United States
7 shared publications - Kendall Harcourt
Division of General Medicine, Beth Israel Deaconess Medical Center, Boston, MA, United States
7 shared publications - Tom Delbanco
Division of General Medicine, Beth Israel Deaconess Medical Center, Boston, MA, United States
7 shared publications - Hannah Shucard
Division of General Internal Medicine, School of Medicine, University of Washington, Seattle, WA, United States
5 shared publications - Joann G. Elmore
David Geffen School of Medicine, Department of Medicine, University of California, Los Angeles
5 shared publications
Latest Publications
- Open Access
- 6 March 2025
- Published by Oxford University Press (OUP) in JAMIA Open
- Vol. 8  (2) , ooaf021
A proof-of-concept study for patient use of open notes with large language models
Objectives: The use of large language models (LLMs) is growing for both clinicians and patients. While researchers and clinicians have explored LLMs to manage patient portal messages and reduce burnout, there is less documentation about how patients use these tools to understand clinical notes and inform decision-making. This proof-of-concept study examined the reliability and accuracy of LLMs in responding to patient queries based on an open visit note. Materials and Methods: In a cross-sectional proof-of-concept study, 3 commercially available LLMs (ChatGPT 4o, Claude 3 Opus, Gemini 1.5) were evaluated using 4 distinct prompt series—Standard, Randomized, Persona, and Randomized Persona—with multiple questions, designed by patients, in response to a single neuro-oncology progress note. LLM responses were scored by the note author (neuro-oncologist) and a patient who receives care from the note author, using an 8-criterion rubric that assessed Accuracy, Relevance, Clarity, Actionability, Empathy/Tone, Completeness, Evidence, and Consistency. Descriptive statistics were used to summarize the performance of each LLM across all prompts. Results: Overall, the Standard and Persona-based prompt series yielded the best results across all criterion regardless of LLM. Chat-GPT 4o using Persona-based prompts scored highest in all categories. All LLMs scored low in the use of Evidence. Discussion: This proof-of-concept study highlighted the potential for LLMs to assist patients in interpreting open notes. The most effective LLM responses were achieved by applying Persona-style prompts to a patient’s question. Conclusion: Optimizing LLMs for patient-driven queries, and patient education and counseling around the use of LLMs, have potential to enhance patient use and understanding of their health information.
- 6 March 2025
- Published by Oxford University Press (OUP) in JAMIA Open
- Vol. 8  (2) , ooaf021
Open AccessA proof-of-concept study for patient use of open notes with large language models
Objectives: The use of large language models (LLMs) is growing for both clinicians and patients. While researchers and clinicians have explored LLMs to manage patient portal messages and reduce burnout, there is less documentation about how patients use these tools to understand clinical notes and inform decision-making. This proof-of-concept study examined the reliability and accuracy of LLMs in responding to patient queries based on an open visit note. Materials and Methods: In a cross-sectional proof-of-concept study, 3 commercially available LLMs (ChatGPT 4o, Claude 3 Opus, Gemini 1.5) were evaluated using 4 distinct prompt series—Standard, Randomized, Persona, and Randomized Persona—with multiple questions, designed by patients, in response to a single neuro-oncology progress note. LLM responses were scored by the note author (neuro-oncologist) and a patient who receives care from the note author, using an 8-criterion rubric that assessed Accuracy, Relevance, Clarity, Actionability, Empathy/Tone, Completeness, Evidence, and Consistency. Descriptive statistics were used to summarize the performance of each LLM across all prompts. Results: Overall, the Standard and Persona-based prompt series yielded the best results across all criterion regardless of LLM. Chat-GPT 4o using Persona-based prompts scored highest in all categories. All LLMs scored low in the use of Evidence. Discussion: This proof-of-concept study highlighted the potential for LLMs to assist patients in interpreting open notes. The most effective LLM responses were achieved by applying Persona-style prompts to a patient’s question. Conclusion: Optimizing LLMs for patient-driven queries, and patient education and counseling around the use of LLMs, have potential to enhance patient use and understanding of their health information.
- Open Access
- 4 March 2025
- Published by JMIR Publications Inc. in JMIR Research Protocols
- Vol. 14  (1) , e66708
Identifying, Engaging, and Supporting Care Partners in Clinical Settings: Protocol for a Patient Portal–Based Intervention
Background: In the United States, the landscape of unpaid care delivery is both challenging and complex, with millions of individuals undertaking the vital role of helping families (broadly defined) manage their health care and well-being. This includes 48 million caregivers of adults, 42 million of whom are caregivers of adults aged 50 years or older. These family care partners provide critical and often daily support for tasks such as dressing and bathing, as well as managing medications, medical equipment, appointments, and follow-up care plans. Objective: This study aimed to implement a novel patient portal–based intervention to identify, engage, and support care partners in clinical settings. Methods: The project team collaborated with 3 health care organizations (6 primary care practices in total) to design and implement a patient portal–based intervention. Three days in advance of a visit, patients were invited to log on to their patient portal account and answer a brief questionnaire as part of the routine electronic check-in process asking them to (1) identify themselves as the patient or someone answering for the patient, (2) report major life changes, (3) set the agenda for the upcoming visit, and (4) report on care partner responsibilities. Respondents’ answers to this brief questionnaire were available to providers ahead of the visit. Patients with care partner responsibilities, as well as care partners answering the questionnaire on behalf of patients, were provided a link to the ARCHANGELS Caregiver Intensity Index to measure the intensity of their caregiving role and motivate care partners to connect with suggested state and local resources. Results: The intervention was launched in September 2022 at Organization A. Organization B launched in May 2023 in one clinic and June 2023 in the other. In focus groups, staff and clinicians reported that the intervention was easy to implement and did not cause workflow disruption. At 6 months post implementation, across both organizations, a total of 22,152 patients had received questionnaires and 13,825 (62.4%) had submitted completed questionnaires. Full data will be reported at the completion of the intervention period. Conclusions: Early results suggest that the intervention could be an easily scalable and adaptable method of identifying and supporting care partners in clinical settings. International Registered Report Identifier (IRRID): DERR1-10.2196/66708
- 4 March 2025
- Published by JMIR Publications Inc. in JMIR Research Protocols
- Vol. 14  (1) , e66708
Open AccessIdentifying, Engaging, and Supporting Care Partners in Clinical Settings: Protocol for a Patient Portal–Based Intervention
Background: In the United States, the landscape of unpaid care delivery is both challenging and complex, with millions of individuals undertaking the vital role of helping families (broadly defined) manage their health care and well-being. This includes 48 million caregivers of adults, 42 million of whom are caregivers of adults aged 50 years or older. These family care partners provide critical and often daily support for tasks such as dressing and bathing, as well as managing medications, medical equipment, appointments, and follow-up care plans. Objective: This study aimed to implement a novel patient portal–based intervention to identify, engage, and support care partners in clinical settings. Methods: The project team collaborated with 3 health care organizations (6 primary care practices in total) to design and implement a patient portal–based intervention. Three days in advance of a visit, patients were invited to log on to their patient portal account and answer a brief questionnaire as part of the routine electronic check-in process asking them to (1) identify themselves as the patient or someone answering for the patient, (2) report major life changes, (3) set the agenda for the upcoming visit, and (4) report on care partner responsibilities. Respondents’ answers to this brief questionnaire were available to providers ahead of the visit. Patients with care partner responsibilities, as well as care partners answering the questionnaire on behalf of patients, were provided a link to the ARCHANGELS Caregiver Intensity Index to measure the intensity of their caregiving role and motivate care partners to connect with suggested state and local resources. Results: The intervention was launched in September 2022 at Organization A. Organization B launched in May 2023 in one clinic and June 2023 in the other. In focus groups, staff and clinicians reported that the intervention was easy to implement and did not cause workflow disruption. At 6 months post implementation, across both organizations, a total of 22,152 patients had received questionnaires and 13,825 (62.4%) had submitted completed questionnaires. Full data will be reported at the completion of the intervention period. Conclusions: Early results suggest that the intervention could be an easily scalable and adaptable method of identifying and supporting care partners in clinical settings. International Registered Report Identifier (IRRID): DERR1-10.2196/66708
- Open Access
- 20 September 2024
- Published by JMIR Publications Inc. in JMIR Preprints
Identifying, Engaging, and Supporting Care Partners in Clinical Settings: Protocol for a Patient Portal–Based Intervention (Preprint)
BACKGROUND In the United States, the landscape of unpaid care delivery is both challenging and complex, with millions of individuals undertaking the vital role of helping families (broadly defined) manage their health care and well-being. This includes 48 million caregivers of adults, 42 million of whom are caregivers of adults aged 50 years or older. These family care partners provide critical and often daily support for tasks such as dressing and bathing, as well as managing medications, medical equipment, appointments, and follow-up care plans. OBJECTIVE This study aimed to implement a novel patient portal–based intervention to identify, engage, and support care partners in clinical settings. METHODS The project team collaborated with 3 health care organizations (6 primary care practices in total) to design and implement a patient portal–based intervention. Three days in advance of a visit, patients were invited to log on to their patient portal account and answer a brief questionnaire as part of the routine electronic check-in process asking them to (1) identify themselves as the patient or someone answering for the patient, (2) report major life changes, (3) set the agenda for the upcoming visit, and (4) report on care partner responsibilities. Respondents’ answers to this brief questionnaire were available to providers ahead of the visit. Patients with care partner responsibilities, as well as care partners answering the questionnaire on behalf of patients, were provided a link to the ARCHANGELS Caregiver Intensity Index to measure the intensity of their caregiving role and motivate care partners to connect with suggested state and local resources. RESULTS The intervention was launched in September 2022 at Organization A. Organization B launched in May 2023 in one clinic and June 2023 in the other. In focus groups, staff and clinicians reported that the intervention was easy to implement and did not cause workflow disruption. At 6 months post implementation, across both organizations, a total of 22,152 patients had received questionnaires and 13,825 (62.4%) had submitted completed questionnaires. Full data will be reported at the completion of the intervention period. CONCLUSIONS Early results suggest that the intervention could be an easily scalable and adaptable method of identifying and supporting care partners in clinical settings. INTERNATIONAL REGISTERED REPORT DERR1-10.2196/66708
- 20 September 2024
- Published by JMIR Publications Inc. in JMIR Preprints
Open AccessIdentifying, Engaging, and Supporting Care Partners in Clinical Settings: Protocol for a Patient Portal–Based Intervention (Preprint)
BACKGROUND In the United States, the landscape of unpaid care delivery is both challenging and complex, with millions of individuals undertaking the vital role of helping families (broadly defined) manage their health care and well-being. This includes 48 million caregivers of adults, 42 million of whom are caregivers of adults aged 50 years or older. These family care partners provide critical and often daily support for tasks such as dressing and bathing, as well as managing medications, medical equipment, appointments, and follow-up care plans. OBJECTIVE This study aimed to implement a novel patient portal–based intervention to identify, engage, and support care partners in clinical settings. METHODS The project team collaborated with 3 health care organizations (6 primary care practices in total) to design and implement a patient portal–based intervention. Three days in advance of a visit, patients were invited to log on to their patient portal account and answer a brief questionnaire as part of the routine electronic check-in process asking them to (1) identify themselves as the patient or someone answering for the patient, (2) report major life changes, (3) set the agenda for the upcoming visit, and (4) report on care partner responsibilities. Respondents’ answers to this brief questionnaire were available to providers ahead of the visit. Patients with care partner responsibilities, as well as care partners answering the questionnaire on behalf of patients, were provided a link to the ARCHANGELS Caregiver Intensity Index to measure the intensity of their caregiving role and motivate care partners to connect with suggested state and local resources. RESULTS The intervention was launched in September 2022 at Organization A. Organization B launched in May 2023 in one clinic and June 2023 in the other. In focus groups, staff and clinicians reported that the intervention was easy to implement and did not cause workflow disruption. At 6 months post implementation, across both organizations, a total of 22,152 patients had received questionnaires and 13,825 (62.4%) had submitted completed questionnaires. Full data will be reported at the completion of the intervention period. CONCLUSIONS Early results suggest that the intervention could be an easily scalable and adaptable method of identifying and supporting care partners in clinical settings. INTERNATIONAL REGISTERED REPORT DERR1-10.2196/66708
- Open Access
- 29 August 2024
- Published by JMIR Publications Inc. in JMIR Formative Research
- Vol. 8  (1) , e56332
Leveraging an Electronic Health Record Patient Portal to Help Patients Formulate Their Health Care Goals: Mixed Methods Evaluation of Pilot Interventions
Background: Persons with multiple chronic conditions face complex medical regimens and clinicians may not focus on what matters most to these patients who vary widely in their health priorities. Patient Priorities Care is a facilitator-led process designed to identify patients’ priorities and align decision-making and care, but the need for a facilitator has limited its widespread adoption. Objective: The aims of this study are to design and test mechanisms for patients to complete a self-directed process for identifying priorities and providing their priorities to clinicians. Methods: The study involved patients of at least 65 years of age at 2 family medicine practices with 5 physicians each. We first tested 2 versions of an interactive website and asked patients to bring their results to their visit. We then tested an Epic previsit questionnaire derived from the website’s questions and included standard previsit materials. We completed postintervention phone interviews and an online survey with participating patients and collected informal feedback and conducted a focus group with participating physicians. Results: In the test of the first website version, 17.3% (35/202) of invited patients went to the website, 11.4% (23/202) completed all of the questions, 2.5% (5/202) brought results to their visits, and the median session time was 43.0 (IQR 28.0) minutes. Patients expressed confusion about bringing results to the visit. After clarifying that issue in the second version, 15.1% (32/212) of patients went to the website, 14.6% (31/212) completed the questions, 1.9% (4/212) brought results to the visit, and the median session time was 35.0 (IQR 35.0) minutes. In the test of the Epic questionnaire, 26.4% (198/750) of patients completed the questionnaire before at least 1 visit, and the median completion time was 14.0 (IQR 23.0) minutes. The 8 main questions were answered 62.9% (129/205) to 95.6% (196/205) of the time. Patients who completed questionnaires were younger than those who did not (72.3 vs 76.1 years) and were more likely to complete at least 1 of their other assigned questionnaires (99.5%, 197/198) than those who did not (10.3%, 57/552). A total of 140 of 198 (70.7%) patients responded to a survey, and 86 remembered completing the questionnaire; 78 (90.7%) did not remember having difficulty answering the questions and 57 (68.7%) agreed or somewhat agreed that it helped them and their clinicians to understand their priorities. Doctors noted that the sickest patients did not complete the questionnaire and that the discussion provided a good segue into end-of-life care. Conclusions: Embedding questionnaires assaying patient priorities into patient portals holds promise for expanding access to priorities-concordant care.
- 29 August 2024
- Published by JMIR Publications Inc. in JMIR Formative Research
- Vol. 8  (1) , e56332
Open AccessLeveraging an Electronic Health Record Patient Portal to Help Patients Formulate Their Health Care Goals: Mixed Methods Evaluation of Pilot Interventions
Background: Persons with multiple chronic conditions face complex medical regimens and clinicians may not focus on what matters most to these patients who vary widely in their health priorities. Patient Priorities Care is a facilitator-led process designed to identify patients’ priorities and align decision-making and care, but the need for a facilitator has limited its widespread adoption. Objective: The aims of this study are to design and test mechanisms for patients to complete a self-directed process for identifying priorities and providing their priorities to clinicians. Methods: The study involved patients of at least 65 years of age at 2 family medicine practices with 5 physicians each. We first tested 2 versions of an interactive website and asked patients to bring their results to their visit. We then tested an Epic previsit questionnaire derived from the website’s questions and included standard previsit materials. We completed postintervention phone interviews and an online survey with participating patients and collected informal feedback and conducted a focus group with participating physicians. Results: In the test of the first website version, 17.3% (35/202) of invited patients went to the website, 11.4% (23/202) completed all of the questions, 2.5% (5/202) brought results to their visits, and the median session time was 43.0 (IQR 28.0) minutes. Patients expressed confusion about bringing results to the visit. After clarifying that issue in the second version, 15.1% (32/212) of patients went to the website, 14.6% (31/212) completed the questions, 1.9% (4/212) brought results to the visit, and the median session time was 35.0 (IQR 35.0) minutes. In the test of the Epic questionnaire, 26.4% (198/750) of patients completed the questionnaire before at least 1 visit, and the median completion time was 14.0 (IQR 23.0) minutes. The 8 main questions were answered 62.9% (129/205) to 95.6% (196/205) of the time. Patients who completed questionnaires were younger than those who did not (72.3 vs 76.1 years) and were more likely to complete at least 1 of their other assigned questionnaires (99.5%, 197/198) than those who did not (10.3%, 57/552). A total of 140 of 198 (70.7%) patients responded to a survey, and 86 remembered completing the questionnaire; 78 (90.7%) did not remember having difficulty answering the questions and 57 (68.7%) agreed or somewhat agreed that it helped them and their clinicians to understand their priorities. Doctors noted that the sickest patients did not complete the questionnaire and that the discussion provided a good segue into end-of-life care. Conclusions: Embedding questionnaires assaying patient priorities into patient portals holds promise for expanding access to priorities-concordant care.
- Open Access
- 24 January 2024
- Published by JMIR Publications Inc. in JMIR Preprints
Leveraging an Electronic Health Record Patient Portal to Help Patients Formulate Their Health Care Goals: Mixed Methods Evaluation of Pilot Interventions (Preprint)
BACKGROUND Persons with multiple chronic conditions face complex medical regimens and clinicians may not focus on what matters most to these patients who vary widely in their health priorities. Patient Priorities Care is a facilitator-led process designed to identify patients’ priorities and align decision-making and care, but the need for a facilitator has limited its widespread adoption. OBJECTIVE The aims of this study are to design and test mechanisms for patients to complete a self-directed process for identifying priorities and providing their priorities to clinicians. METHODS The study involved patients of at least 65 years of age at 2 family medicine practices with 5 physicians each. We first tested 2 versions of an interactive website and asked patients to bring their results to their visit. We then tested an Epic previsit questionnaire derived from the website’s questions and included standard previsit materials. We completed postintervention phone interviews and an online survey with participating patients and collected informal feedback and conducted a focus group with participating physicians. RESULTS In the test of the first website version, 17.3% (35/202) of invited patients went to the website, 11.4% (23/202) completed all of the questions, 2.5% (5/202) brought results to their visits, and the median session time was 43.0 (IQR 28.0) minutes. Patients expressed confusion about bringing results to the visit. After clarifying that issue in the second version, 15.1% (32/212) of patients went to the website, 14.6% (31/212) completed the questions, 1.9% (4/212) brought results to the visit, and the median session time was 35.0 (IQR 35.0) minutes. In the test of the Epic questionnaire, 26.4% (198/750) of patients completed the questionnaire before at least 1 visit, and the median completion time was 14.0 (IQR 23.0) minutes. The 8 main questions were answered 62.9% (129/205) to 95.6% (196/205) of the time. Patients who completed questionnaires were younger than those who did not (72.3 vs 76.1 years) and were more likely to complete at least 1 of their other assigned questionnaires (99.5%, 197/198) than those who did not (10.3%, 57/552). A total of 140 of 198 (70.7%) patients responded to a survey, and 86 remembered completing the questionnaire; 78 (90.7%) did not remember having difficulty answering the questions and 57 (68.7%) agreed or somewhat agreed that it helped them and their clinicians to understand their priorities. Doctors noted that the sickest patients did not complete the questionnaire and that the discussion provided a good segue into end-of-life care. CONCLUSIONS Embedding questionnaires assaying patient priorities into patient portals holds promise for expanding access to priorities-concordant care. CLINICALTRIAL
- 24 January 2024
- Published by JMIR Publications Inc. in JMIR Preprints
Open AccessLeveraging an Electronic Health Record Patient Portal to Help Patients Formulate Their Health Care Goals: Mixed Methods Evaluation of Pilot Interventions (Preprint)
BACKGROUND Persons with multiple chronic conditions face complex medical regimens and clinicians may not focus on what matters most to these patients who vary widely in their health priorities. Patient Priorities Care is a facilitator-led process designed to identify patients’ priorities and align decision-making and care, but the need for a facilitator has limited its widespread adoption. OBJECTIVE The aims of this study are to design and test mechanisms for patients to complete a self-directed process for identifying priorities and providing their priorities to clinicians. METHODS The study involved patients of at least 65 years of age at 2 family medicine practices with 5 physicians each. We first tested 2 versions of an interactive website and asked patients to bring their results to their visit. We then tested an Epic previsit questionnaire derived from the website’s questions and included standard previsit materials. We completed postintervention phone interviews and an online survey with participating patients and collected informal feedback and conducted a focus group with participating physicians. RESULTS In the test of the first website version, 17.3% (35/202) of invited patients went to the website, 11.4% (23/202) completed all of the questions, 2.5% (5/202) brought results to their visits, and the median session time was 43.0 (IQR 28.0) minutes. Patients expressed confusion about bringing results to the visit. After clarifying that issue in the second version, 15.1% (32/212) of patients went to the website, 14.6% (31/212) completed the questions, 1.9% (4/212) brought results to the visit, and the median session time was 35.0 (IQR 35.0) minutes. In the test of the Epic questionnaire, 26.4% (198/750) of patients completed the questionnaire before at least 1 visit, and the median completion time was 14.0 (IQR 23.0) minutes. The 8 main questions were answered 62.9% (129/205) to 95.6% (196/205) of the time. Patients who completed questionnaires were younger than those who did not (72.3 vs 76.1 years) and were more likely to complete at least 1 of their other assigned questionnaires (99.5%, 197/198) than those who did not (10.3%, 57/552). A total of 140 of 198 (70.7%) patients responded to a survey, and 86 remembered completing the questionnaire; 78 (90.7%) did not remember having difficulty answering the questions and 57 (68.7%) agreed or somewhat agreed that it helped them and their clinicians to understand their priorities. Doctors noted that the sickest patients did not complete the questionnaire and that the discussion provided a good segue into end-of-life care. CONCLUSIONS Embedding questionnaires assaying patient priorities into patient portals holds promise for expanding access to priorities-concordant care. CLINICALTRIAL
- Open Access
- 22 February 2023
- Published by JMIR Publications Inc. in Journal of Medical Internet Research
- Vol. 25, e43496
Patient Online Record Access in English Primary Care: Qualitative Survey Study of General Practitioners’ Views
Background: In 2022, NHS England announced plans to ensure that all adult primary care patients in England would have full online access to new data added to their general practitioner (GP) record. However, this plan has not yet been fully implemented. Since April 2020, the GP contract in England has already committed to offering patients full online record access on a prospective basis and on request. However, there has been limited research into UK GPs’ experiences and opinions about this practice innovation. Objective: This study aimed to explore the experiences and opinions of GPs in England about patients’ access to their full web-based health record, including clinicians’ free-text summaries of the consultation (so-called “open notes”). Methods: In March 2022, using a convenience sample, we administered a web-based mixed methods survey of 400 GPs in the United Kingdom to explore their experiences and opinions about the impact on patients and GPs’ practices to offer patients full online access to their health records. Participants were recruited using the clinician marketing service Doctors.net.uk from registered GPs currently working in England. We conducted a qualitative descriptive analysis of written responses (“comments”) to 4 open-ended questions embedded in a web-based questionnaire. Results: Of 400 GPs, 224 (56%) left comments that were classified into 4 major themes: increased strain on GP practices, the potential to harm patients, changes to documentation, and legal concerns. GPs believed that patient access would lead to extra work for them, reduced efficiency, and increased burnout. The participants also believed that access would increase patient anxiety and incur risks to patient safety. Experienced and perceived documentation changes included reduced candor and changes to record functionality. Anticipated legal concerns encompassed fears about increased litigation risks and lack of legal guidance to GPs about how to manage documentation that would be read by patients and potential third parties. Conclusions: This study provides timely information on the views of GPs in England regarding patient access to their web-based health records. Overwhelmingly, GPs were skeptical about the benefits of access both for patients and to their practices. These views are similar to those expressed by clinicians in other countries, including Nordic countries and the United States before patient access. The survey was limited by the convenience sample, and it is not possible to infer that our sample was representative of the opinions of GPs in England. More extensive, qualitative research is required to understand the perspectives of patients in England after experiencing access to their web-based records. Finally, further research is needed to explore objective measures of the impact of patient access to their records on health outcomes, clinician workload, and changes to documentation.
- 22 February 2023
- Published by JMIR Publications Inc. in Journal of Medical Internet Research
- Vol. 25, e43496
Open AccessPatient Online Record Access in English Primary Care: Qualitative Survey Study of General Practitioners’ Views
Background: In 2022, NHS England announced plans to ensure that all adult primary care patients in England would have full online access to new data added to their general practitioner (GP) record. However, this plan has not yet been fully implemented. Since April 2020, the GP contract in England has already committed to offering patients full online record access on a prospective basis and on request. However, there has been limited research into UK GPs’ experiences and opinions about this practice innovation. Objective: This study aimed to explore the experiences and opinions of GPs in England about patients’ access to their full web-based health record, including clinicians’ free-text summaries of the consultation (so-called “open notes”). Methods: In March 2022, using a convenience sample, we administered a web-based mixed methods survey of 400 GPs in the United Kingdom to explore their experiences and opinions about the impact on patients and GPs’ practices to offer patients full online access to their health records. Participants were recruited using the clinician marketing service Doctors.net.uk from registered GPs currently working in England. We conducted a qualitative descriptive analysis of written responses (“comments”) to 4 open-ended questions embedded in a web-based questionnaire. Results: Of 400 GPs, 224 (56%) left comments that were classified into 4 major themes: increased strain on GP practices, the potential to harm patients, changes to documentation, and legal concerns. GPs believed that patient access would lead to extra work for them, reduced efficiency, and increased burnout. The participants also believed that access would increase patient anxiety and incur risks to patient safety. Experienced and perceived documentation changes included reduced candor and changes to record functionality. Anticipated legal concerns encompassed fears about increased litigation risks and lack of legal guidance to GPs about how to manage documentation that would be read by patients and potential third parties. Conclusions: This study provides timely information on the views of GPs in England regarding patient access to their web-based health records. Overwhelmingly, GPs were skeptical about the benefits of access both for patients and to their practices. These views are similar to those expressed by clinicians in other countries, including Nordic countries and the United States before patient access. The survey was limited by the convenience sample, and it is not possible to infer that our sample was representative of the opinions of GPs in England. More extensive, qualitative research is required to understand the perspectives of patients in England after experiencing access to their web-based records. Finally, further research is needed to explore objective measures of the impact of patient access to their records on health outcomes, clinician workload, and changes to documentation.
- Open Access
- 14 October 2022
- Published by JMIR Publications Inc. in JMIR Preprints
Patient Online Record Access in English Primary Care: Qualitative Survey Study of General Practitioners’ Views (Preprint)
BACKGROUND In 2022, NHS England announced plans to ensure that all adult primary care patients in England would have full online access to new data added to their general practitioner (GP) record. However, this plan has not yet been fully implemented. Since April 2020, the GP contract in England has already committed to offering patients full online record access on a prospective basis and on request. However, there has been limited research into UK GPs’ experiences and opinions about this practice innovation. OBJECTIVE This study aimed to explore the experiences and opinions of GPs in England about patients’ access to their full web-based health record, including clinicians’ free-text summaries of the consultation (so-called “open notes”). METHODS In March 2022, using a convenience sample, we administered a web-based mixed methods survey of 400 GPs in the United Kingdom to explore their experiences and opinions about the impact on patients and GPs’ practices to offer patients full online access to their health records. Participants were recruited using the clinician marketing service Doctors.net.uk from registered GPs currently working in England. We conducted a qualitative descriptive analysis of written responses (“comments”) to 4 open-ended questions embedded in a web-based questionnaire. RESULTS Of 400 GPs, 224 (56%) left comments that were classified into 4 major themes: increased strain on GP practices, the potential to harm patients, changes to documentation, and legal concerns. GPs believed that patient access would lead to extra work for them, reduced efficiency, and increased burnout. The participants also believed that access would increase patient anxiety and incur risks to patient safety. Experienced and perceived documentation changes included reduced candor and changes to record functionality. Anticipated legal concerns encompassed fears about increased litigation risks and lack of legal guidance to GPs about how to manage documentation that would be read by patients and potential third parties. CONCLUSIONS This study provides timely information on the views of GPs in England regarding patient access to their web-based health records. Overwhelmingly, GPs were skeptical about the benefits of access both for patients and to their practices. These views are similar to those expressed by clinicians in other countries, including Nordic countries and the United States before patient access. The survey was limited by the convenience sample, and it is not possible to infer that our sample was representative of the opinions of GPs in England. More extensive, qualitative research is required to understand the perspectives of patients in England after experiencing access to their web-based records. Finally, further research is needed to explore objective measures of the impact of patient access to their records on health outcomes, clinician workload, and changes to documentation.
- 14 October 2022
- Published by JMIR Publications Inc. in JMIR Preprints
Open AccessPatient Online Record Access in English Primary Care: Qualitative Survey Study of General Practitioners’ Views (Preprint)
BACKGROUND In 2022, NHS England announced plans to ensure that all adult primary care patients in England would have full online access to new data added to their general practitioner (GP) record. However, this plan has not yet been fully implemented. Since April 2020, the GP contract in England has already committed to offering patients full online record access on a prospective basis and on request. However, there has been limited research into UK GPs’ experiences and opinions about this practice innovation. OBJECTIVE This study aimed to explore the experiences and opinions of GPs in England about patients’ access to their full web-based health record, including clinicians’ free-text summaries of the consultation (so-called “open notes”). METHODS In March 2022, using a convenience sample, we administered a web-based mixed methods survey of 400 GPs in the United Kingdom to explore their experiences and opinions about the impact on patients and GPs’ practices to offer patients full online access to their health records. Participants were recruited using the clinician marketing service Doctors.net.uk from registered GPs currently working in England. We conducted a qualitative descriptive analysis of written responses (“comments”) to 4 open-ended questions embedded in a web-based questionnaire. RESULTS Of 400 GPs, 224 (56%) left comments that were classified into 4 major themes: increased strain on GP practices, the potential to harm patients, changes to documentation, and legal concerns. GPs believed that patient access would lead to extra work for them, reduced efficiency, and increased burnout. The participants also believed that access would increase patient anxiety and incur risks to patient safety. Experienced and perceived documentation changes included reduced candor and changes to record functionality. Anticipated legal concerns encompassed fears about increased litigation risks and lack of legal guidance to GPs about how to manage documentation that would be read by patients and potential third parties. CONCLUSIONS This study provides timely information on the views of GPs in England regarding patient access to their web-based health records. Overwhelmingly, GPs were skeptical about the benefits of access both for patients and to their practices. These views are similar to those expressed by clinicians in other countries, including Nordic countries and the United States before patient access. The survey was limited by the convenience sample, and it is not possible to infer that our sample was representative of the opinions of GPs in England. More extensive, qualitative research is required to understand the perspectives of patients in England after experiencing access to their web-based records. Finally, further research is needed to explore objective measures of the impact of patient access to their records on health outcomes, clinician workload, and changes to documentation.
- Open Access
- 8 November 2021
- Published by JMIR Publications Inc. in Journal of Medical Internet Research
- Vol. 23  (11) , e29951
Patients Contributing to Visit Notes: Mixed Methods Evaluation of OurNotes
Background: Secure patient portals are widely available, and patients use them to view their electronic health records, including their clinical notes. We conducted experiments asking them to cogenerate notes with their clinicians, an intervention called OurNotes. Objective: This study aims to assess patient and provider experiences and attitudes after 12 months of a pilot intervention. Methods: Before scheduled primary care visits, patients were asked to submit a word-constrained, unstructured interval history and an agenda for what they would like to discuss at the visit. Using site-specific methods, their providers were invited to incorporate the submissions into notes documenting the visits. Sites served urban, suburban, and rural patients in primary care practices in 4 academic health centers in Boston (Massachusetts), Lebanon (New Hampshire), Denver (Colorado), and Seattle (Washington). Each practice offered electronic access to visit notes (open notes) to its patients for several years. A mixed methods evaluation used tracking data and electronic survey responses from patients and clinicians. Participants were 174 providers and 1962 patients who submitted at least 1 previsit form. We asked providers about the usefulness of the submissions, effects on workflow, and ideas for the future. We asked patients about difficulties and benefits of providing the requested information and ideas for future improvements. Results: Forms were submitted before 9.15% (5365/58,652) eligible visits, and 43.7% (76/174) providers and 26.76% (525/1962) patients responded to the postintervention evaluation surveys; 74 providers and 321 patients remembered receiving and completing the forms and answered the survey questions. Most clinicians thought interim patient histories (69/74, 93%) and patient agendas (72/74, 97%) as good ideas, 70% (52/74) usually or always incorporated them into visit notes, 54% (40/74) reported no change in visit length, and 35% (26/74) thought they saved time. Their most common suggestions related to improving notifications when patient forms were received, making it easier to find the form and insert it into the note, and educating patients about how best to prepare their submissions. Patient respondents were generally well educated, most found the history (259/321, 80.7%) and agenda (286/321, 89.1%) questions not difficult to answer; more than 92.2% (296/321) thought sending answers before the visit a good idea; 68.8% (221/321) thought the questions helped them prepare for the visit. Common suggestions by patients included learning to write better answers and wanting to know that their submissions were read by their clinicians. At the end of the pilot, all participating providers chose to continue the OurNotes previsit form, and sites considered expanding the intervention to more clinicians and adapting it for telemedicine visits. Conclusions: OurNotes interests patients, and providers experience it as a positive intervention. Participation by patients, care partners, clinicians, and electronic health record experts will facilitate further development.
- 8 November 2021
- Published by JMIR Publications Inc. in Journal of Medical Internet Research
- Vol. 23  (11) , e29951
Open AccessPatients Contributing to Visit Notes: Mixed Methods Evaluation of OurNotes
Background: Secure patient portals are widely available, and patients use them to view their electronic health records, including their clinical notes. We conducted experiments asking them to cogenerate notes with their clinicians, an intervention called OurNotes. Objective: This study aims to assess patient and provider experiences and attitudes after 12 months of a pilot intervention. Methods: Before scheduled primary care visits, patients were asked to submit a word-constrained, unstructured interval history and an agenda for what they would like to discuss at the visit. Using site-specific methods, their providers were invited to incorporate the submissions into notes documenting the visits. Sites served urban, suburban, and rural patients in primary care practices in 4 academic health centers in Boston (Massachusetts), Lebanon (New Hampshire), Denver (Colorado), and Seattle (Washington). Each practice offered electronic access to visit notes (open notes) to its patients for several years. A mixed methods evaluation used tracking data and electronic survey responses from patients and clinicians. Participants were 174 providers and 1962 patients who submitted at least 1 previsit form. We asked providers about the usefulness of the submissions, effects on workflow, and ideas for the future. We asked patients about difficulties and benefits of providing the requested information and ideas for future improvements. Results: Forms were submitted before 9.15% (5365/58,652) eligible visits, and 43.7% (76/174) providers and 26.76% (525/1962) patients responded to the postintervention evaluation surveys; 74 providers and 321 patients remembered receiving and completing the forms and answered the survey questions. Most clinicians thought interim patient histories (69/74, 93%) and patient agendas (72/74, 97%) as good ideas, 70% (52/74) usually or always incorporated them into visit notes, 54% (40/74) reported no change in visit length, and 35% (26/74) thought they saved time. Their most common suggestions related to improving notifications when patient forms were received, making it easier to find the form and insert it into the note, and educating patients about how best to prepare their submissions. Patient respondents were generally well educated, most found the history (259/321, 80.7%) and agenda (286/321, 89.1%) questions not difficult to answer; more than 92.2% (296/321) thought sending answers before the visit a good idea; 68.8% (221/321) thought the questions helped them prepare for the visit. Common suggestions by patients included learning to write better answers and wanting to know that their submissions were read by their clinicians. At the end of the pilot, all participating providers chose to continue the OurNotes previsit form, and sites considered expanding the intervention to more clinicians and adapting it for telemedicine visits. Conclusions: OurNotes interests patients, and providers experience it as a positive intervention. Participation by patients, care partners, clinicians, and electronic health record experts will facilitate further development.
- Open Access
- 26 April 2021
- Published by JMIR Publications Inc. in JMIR Preprints
Patients Contributing to Visit Notes: Mixed Methods Evaluation of OurNotes (Preprint)
BACKGROUND Secure patient portals are widely available, and patients use them to view their electronic health records, including their clinical notes. We conducted experiments asking them to cogenerate notes with their clinicians, an intervention called OurNotes. OBJECTIVE This study aims to assess patient and provider experiences and attitudes after 12 months of a pilot intervention. METHODS Before scheduled primary care visits, patients were asked to submit a word-constrained, unstructured interval history and an agenda for what they would like to discuss at the visit. Using site-specific methods, their providers were invited to incorporate the submissions into notes documenting the visits. Sites served urban, suburban, and rural patients in primary care practices in 4 academic health centers in Boston (Massachusetts), Lebanon (New Hampshire), Denver (Colorado), and Seattle (Washington). Each practice offered electronic access to visit notes (open notes) to its patients for several years. A mixed methods evaluation used tracking data and electronic survey responses from patients and clinicians. Participants were 174 providers and 1962 patients who submitted at least 1 previsit form. We asked providers about the usefulness of the submissions, effects on workflow, and ideas for the future. We asked patients about difficulties and benefits of providing the requested information and ideas for future improvements. RESULTS Forms were submitted before 9.15% (5365/58,652) eligible visits, and 43.7% (76/174) providers and 26.76% (525/1962) patients responded to the postintervention evaluation surveys; 74 providers and 321 patients remembered receiving and completing the forms and answered the survey questions. Most clinicians thought interim patient histories (69/74, 93%) and patient agendas (72/74, 97%) as good ideas, 70% (52/74) usually or always incorporated them into visit notes, 54% (40/74) reported no change in visit length, and 35% (26/74) thought they saved time. Their most common suggestions related to improving notifications when patient forms were received, making it easier to find the form and insert it into the note, and educating patients about how best to prepare their submissions. Patient respondents were generally well educated, most found the history (259/321, 80.7%) and agenda (286/321, 89.1%) questions not difficult to answer; more than 92.2% (296/321) thought sending answers before the visit a good idea; 68.8% (221/321) thought the questions helped them prepare for the visit. Common suggestions by patients included learning to write better answers and wanting to know that their submissions were read by their clinicians. At the end of the pilot, all participating providers chose to continue the OurNotes previsit form, and sites considered expanding the intervention to more clinicians and adapting it for telemedicine visits. CONCLUSIONS OurNotes interests patients, and providers experience it as a positive intervention. Participation by patients, care partners, clinicians, and electronic health record experts will facilitate further development.
- 26 April 2021
- Published by JMIR Publications Inc. in JMIR Preprints
Open AccessPatients Contributing to Visit Notes: Mixed Methods Evaluation of OurNotes (Preprint)
BACKGROUND Secure patient portals are widely available, and patients use them to view their electronic health records, including their clinical notes. We conducted experiments asking them to cogenerate notes with their clinicians, an intervention called OurNotes. OBJECTIVE This study aims to assess patient and provider experiences and attitudes after 12 months of a pilot intervention. METHODS Before scheduled primary care visits, patients were asked to submit a word-constrained, unstructured interval history and an agenda for what they would like to discuss at the visit. Using site-specific methods, their providers were invited to incorporate the submissions into notes documenting the visits. Sites served urban, suburban, and rural patients in primary care practices in 4 academic health centers in Boston (Massachusetts), Lebanon (New Hampshire), Denver (Colorado), and Seattle (Washington). Each practice offered electronic access to visit notes (open notes) to its patients for several years. A mixed methods evaluation used tracking data and electronic survey responses from patients and clinicians. Participants were 174 providers and 1962 patients who submitted at least 1 previsit form. We asked providers about the usefulness of the submissions, effects on workflow, and ideas for the future. We asked patients about difficulties and benefits of providing the requested information and ideas for future improvements. RESULTS Forms were submitted before 9.15% (5365/58,652) eligible visits, and 43.7% (76/174) providers and 26.76% (525/1962) patients responded to the postintervention evaluation surveys; 74 providers and 321 patients remembered receiving and completing the forms and answered the survey questions. Most clinicians thought interim patient histories (69/74, 93%) and patient agendas (72/74, 97%) as good ideas, 70% (52/74) usually or always incorporated them into visit notes, 54% (40/74) reported no change in visit length, and 35% (26/74) thought they saved time. Their most common suggestions related to improving notifications when patient forms were received, making it easier to find the form and insert it into the note, and educating patients about how best to prepare their submissions. Patient respondents were generally well educated, most found the history (259/321, 80.7%) and agenda (286/321, 89.1%) questions not difficult to answer; more than 92.2% (296/321) thought sending answers before the visit a good idea; 68.8% (221/321) thought the questions helped them prepare for the visit. Common suggestions by patients included learning to write better answers and wanting to know that their submissions were read by their clinicians. At the end of the pilot, all participating providers chose to continue the OurNotes previsit form, and sites considered expanding the intervention to more clinicians and adapting it for telemedicine visits. CONCLUSIONS OurNotes interests patients, and providers experience it as a positive intervention. Participation by patients, care partners, clinicians, and electronic health record experts will facilitate further development.
- Open Access
- 30 April 2020
- Published by JMIR Publications Inc. in Journal of Medical Internet Research
- Vol. 22  (4) , e18639
OpenNotes After 7 Years: Patient Experiences With Ongoing Access to Their Clinicians' Outpatient Visit Notes (vol 22, e13876, 2020)
Journal of Medical Internet Research - International Scientific Journal for Medical Research, Information and Communication on the Internet
- 30 April 2020
- Published by JMIR Publications Inc. in Journal of Medical Internet Research
- Vol. 22  (4) , e18639
Open AccessOpenNotes After 7 Years: Patient Experiences With Ongoing Access to Their Clinicians' Outpatient Visit Notes (vol 22, e13876, 2020)
Journal of Medical Internet Research - International Scientific Journal for Medical Research, Information and Communication on the Internet