William Bill Lober
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
William Bill Lober has a total of 163 co-authors. Here are the top co-authors by number of shared publications:
- Debra Revere
Department of Health Systems and Population Health, School of Public Health, University of Washington, Seattle, WA, United States
6 shared publications - Heidi M. Crane
University of Washington, Seattle, WA, USA
5 shared publications - Anne Njoroge
International Training and Education Center for Health, Nairobi, Kenya
4 shared publications - Bryant Thomas Karras
Washington State Department of Health, Tumwater, WA, United States
4 shared publications - George Owiso
International Training and Education Center for Health University of Washington Seattle, WA United States
4 shared publications - Janet Baseman
Department of Epidemiology, School of Public Health, University of Washington, Seattle, WA, United States
4 shared publications
Latest Publications
- Open Access
- 16 September 2026
- Published by JMIR Publications Inc. in JMIR Public Health and Surveillance
- Vol. 12, e77763
Transforming a Pandemic Tool Into a Public Health Asset: Modified Delphi Study
Background: During the COVID-19 pandemic, over 100 countries successfully deployed smartphone-based exposure notification (EN) apps alongside conventional contact tracing to mitigate the transmission of SARS-CoV-2. These systems enabled millions of COVID-19–positive individuals to anonymously alert community members of a potential exposure. Although evidence on EN program implementation is limited, leveraging expertise from public health professionals, academics, and global implementers from various disciplines can contribute to addressing this research gap. Objective: This study aimed to explore barriers and facilitators to adoption, identify optimal use cases for these tools, and understand how advancements in technology and policy might maximize EN utility for mitigating other infectious outbreaks. Methods: We used the Delphi method to develop a comprehensive online survey comprising closed-ended and open-ended questions. We considered consensus was reached when at least 75% of respondents selected “agree” or “strongly agree” for an item or statement. More than 30 global EN experts known to the investigators were invited to participate in the survey, and those who participated were asked to nominate or recruit others deemed eligible via a peer-to-peer method. We used descriptive and content analyses to summarize key findings from the survey. We invited the same experts to attend virtual focus groups to further probe their insights into the survey findings. Results: Twenty-two experts from 6 countries, including 10 experts from the United States, representing 3 continents, participated. Respondents were involved in the implementation of various EN technologies that encompassed varying levels of integration with existing public health agencies’ infrastructure. Consensus was reached concerning the development of additional functionalities of the system, such as the ability for users to self-report a positive result from a SARS-CoV-2 at-home test, receive additional public health information from the app (ie, information on testing and social services), and receive general venue-based notifications concerning superspreader events. Other items that reached consensus included how the tool could be used for additional epidemiological purposes, such as expanding the technology to other airborne diseases, and the need for integration with surveillance data streams to augment analytics and forecasting. Conclusions: Global EN systems have the potential to be optimized for public health emergencies beyond COVID-19 and can be used as epidemiological surveillance tools in future disease outbreaks. Decision-makers and experts should revise existing protocols and seek to incorporate new functionality to alleviate the disease burden on both users and public health agencies.
- 16 September 2026
- Published by JMIR Publications Inc. in JMIR Public Health and Surveillance
- Vol. 12, e77763
Open AccessTransforming a Pandemic Tool Into a Public Health Asset: Modified Delphi Study
Background: During the COVID-19 pandemic, over 100 countries successfully deployed smartphone-based exposure notification (EN) apps alongside conventional contact tracing to mitigate the transmission of SARS-CoV-2. These systems enabled millions of COVID-19–positive individuals to anonymously alert community members of a potential exposure. Although evidence on EN program implementation is limited, leveraging expertise from public health professionals, academics, and global implementers from various disciplines can contribute to addressing this research gap. Objective: This study aimed to explore barriers and facilitators to adoption, identify optimal use cases for these tools, and understand how advancements in technology and policy might maximize EN utility for mitigating other infectious outbreaks. Methods: We used the Delphi method to develop a comprehensive online survey comprising closed-ended and open-ended questions. We considered consensus was reached when at least 75% of respondents selected “agree” or “strongly agree” for an item or statement. More than 30 global EN experts known to the investigators were invited to participate in the survey, and those who participated were asked to nominate or recruit others deemed eligible via a peer-to-peer method. We used descriptive and content analyses to summarize key findings from the survey. We invited the same experts to attend virtual focus groups to further probe their insights into the survey findings. Results: Twenty-two experts from 6 countries, including 10 experts from the United States, representing 3 continents, participated. Respondents were involved in the implementation of various EN technologies that encompassed varying levels of integration with existing public health agencies’ infrastructure. Consensus was reached concerning the development of additional functionalities of the system, such as the ability for users to self-report a positive result from a SARS-CoV-2 at-home test, receive additional public health information from the app (ie, information on testing and social services), and receive general venue-based notifications concerning superspreader events. Other items that reached consensus included how the tool could be used for additional epidemiological purposes, such as expanding the technology to other airborne diseases, and the need for integration with surveillance data streams to augment analytics and forecasting. Conclusions: Global EN systems have the potential to be optimized for public health emergencies beyond COVID-19 and can be used as epidemiological surveillance tools in future disease outbreaks. Decision-makers and experts should revise existing protocols and seek to incorporate new functionality to alleviate the disease burden on both users and public health agencies.
- Open Access
Development and Evaluation of the Personal Patient Profile–Bladder Cancer (P3-BC): A Web-Based Decision Support System for Patients Considering Cystectomy and Urinary Diversion
Background/Objectives: Radical cystectomy with urinary diversion is the standard treatment for patients with muscle-invasive bladder cancer, which represents a complex, preference-sensitive decision about the diversion options. To facilitate patient-clinician shared decision-making, we developed and evaluated the feasibility and acceptability of the Personal Patient Profile–Bladder Cancer (P3-BC), a web-based decision support system for patients considering urinary diversion options. Materials and Methods: We employed an iterative development approach following an established framework, including qualitative assessments of radical cystectomy patients’ (n = 30) needs to inform content development, followed by usability testing with 10 key stakeholders. We then conducted a feasibility study with patients newly diagnosed with bladder cancer undergoing cystectomy. Feasibility was assessed through P3-BC completion rates among patients randomized to the intervention and study retention rates. Acceptability was measured using a program-based 12-item questionnaire integrating the six-item Acceptability E-Scale. Secondary outcomes included decisional conflict, shared decision-making, psychological distress, and decisional regret. Results: Of 114 eligible patients, 24 provided consent (21% consent rate), and 15 were randomized to receive the P3-BC intervention (n = 10) or usual care (n = 5). Retention was 93% at 1 month and 73% at 3 months. Among intervention participants, P3-BC achieved high feasibility (100% accessed the program) and acceptability, with 86% reporting overall satisfaction and 86% reporting ease of use. No statistically significant between-group differences were observed in secondary outcomes. Although the study was not powered to examine group differences, numerical trends suggest improvements in decisional conflict and symptom burden over time, particularly in the intervention group. Conclusions: P3-BC demonstrated feasibility and acceptability as a web-based decision support intervention for patients with bladder cancer considering cystectomy and urinary diversion. Primary barriers to enrollment included treatment burden, limited diagnosis-treatment time, and technology concerns. Findings support progression to an adequately powered randomized controlled trial to evaluate clinical effectiveness.
Open AccessDevelopment and Evaluation of the Personal Patient Profile–Bladder Cancer (P3-BC): A Web-Based Decision Support System for Patients Considering Cystectomy and Urinary Diversion
Background/Objectives: Radical cystectomy with urinary diversion is the standard treatment for patients with muscle-invasive bladder cancer, which represents a complex, preference-sensitive decision about the diversion options. To facilitate patient-clinician shared decision-making, we developed and evaluated the feasibility and acceptability of the Personal Patient Profile–Bladder Cancer (P3-BC), a web-based decision support system for patients considering urinary diversion options. Materials and Methods: We employed an iterative development approach following an established framework, including qualitative assessments of radical cystectomy patients’ (n = 30) needs to inform content development, followed by usability testing with 10 key stakeholders. We then conducted a feasibility study with patients newly diagnosed with bladder cancer undergoing cystectomy. Feasibility was assessed through P3-BC completion rates among patients randomized to the intervention and study retention rates. Acceptability was measured using a program-based 12-item questionnaire integrating the six-item Acceptability E-Scale. Secondary outcomes included decisional conflict, shared decision-making, psychological distress, and decisional regret. Results: Of 114 eligible patients, 24 provided consent (21% consent rate), and 15 were randomized to receive the P3-BC intervention (n = 10) or usual care (n = 5). Retention was 93% at 1 month and 73% at 3 months. Among intervention participants, P3-BC achieved high feasibility (100% accessed the program) and acceptability, with 86% reporting overall satisfaction and 86% reporting ease of use. No statistically significant between-group differences were observed in secondary outcomes. Although the study was not powered to examine group differences, numerical trends suggest improvements in decisional conflict and symptom burden over time, particularly in the intervention group. Conclusions: P3-BC demonstrated feasibility and acceptability as a web-based decision support intervention for patients with bladder cancer considering cystectomy and urinary diversion. Primary barriers to enrollment included treatment burden, limited diagnosis-treatment time, and technology concerns. Findings support progression to an adequately powered randomized controlled trial to evaluate clinical effectiveness.
- 7 October 2025
- Published by Elsevier in Journal of Pain and Symptom Management
- Vol. 71 (1) , 134-143.e1
Assessment of a Zero-Shot Large Language Model in Measuring Documented Goals-of-Care Discussions
- 7 October 2025
- Published by Elsevier in Journal of Pain and Symptom Management
- Vol. 71 (1) , 134-143.e1
Assessment of a Zero-Shot Large Language Model in Measuring Documented Goals-of-Care Discussions
- 1 May 2025
- Published by SAGE Publications in Journal of Alzheimer’s Disease
- Vol. 105 (3) , 825-836
Sharing patient technology preferences with care networks: Stakeholders’ views of the “Let’s Talk Tech” decision aid for dementia care
Background: Let's Talk Tech (LTT) is a self-administered web intervention for people with memory loss and their care partners that supports decision-making about digital health technologies. In past work, dyads wanted to share LTT preference reports with their larger care networks. Objective: This study aims to understand with whom care dyads want to share their technology preference reports and why, and if and how clinicians want to receive them. Methods: Together, fifteen dyads of people living with mild cognitive impairment (MCI) or early-stage dementia (n = 15) and a care partner (n = 15) completed LTT and two survey questions. Care partners completed independent follow-up interviews, and 32 clinicians at four Alzheimer's Disease Research Center-affiliated clinics viewed an LTT report and completed a 10-question survey. We used descriptive statistics for survey responses and thematic analysis for interviews. Results: Two-thirds of care partners (n = 10) wanted to share the report with family members. Half (n = 8) wanted to share it with clinicians to keep them informed about the dyad's planning and facilitate conversations about technology options. 30 of 32 clinicians reported they would want their patients’ technology preferences reports, with 25 wanting to access it via the electronic health record (EHR). Conclusions: Findings demonstrate potential value to both family dyads and providers of sharing technology preferences beyond the care dyad. Clinicians were highly receptive to accessing technology preference reports in EHRs and to having discussions about technology be a part of advance care planning. Future research should test integration in the EHR and the potential of sharing technology preferences to support person-centered technology choices.
- 1 May 2025
- Published by SAGE Publications in Journal of Alzheimer’s Disease
- Vol. 105 (3) , 825-836
Sharing patient technology preferences with care networks: Stakeholders’ views of the “Let’s Talk Tech” decision aid for dementia care
Background: Let's Talk Tech (LTT) is a self-administered web intervention for people with memory loss and their care partners that supports decision-making about digital health technologies. In past work, dyads wanted to share LTT preference reports with their larger care networks. Objective: This study aims to understand with whom care dyads want to share their technology preference reports and why, and if and how clinicians want to receive them. Methods: Together, fifteen dyads of people living with mild cognitive impairment (MCI) or early-stage dementia (n = 15) and a care partner (n = 15) completed LTT and two survey questions. Care partners completed independent follow-up interviews, and 32 clinicians at four Alzheimer's Disease Research Center-affiliated clinics viewed an LTT report and completed a 10-question survey. We used descriptive statistics for survey responses and thematic analysis for interviews. Results: Two-thirds of care partners (n = 10) wanted to share the report with family members. Half (n = 8) wanted to share it with clinicians to keep them informed about the dyad's planning and facilitate conversations about technology options. 30 of 32 clinicians reported they would want their patients’ technology preferences reports, with 25 wanting to access it via the electronic health record (EHR). Conclusions: Findings demonstrate potential value to both family dyads and providers of sharing technology preferences beyond the care dyad. Clinicians were highly receptive to accessing technology preference reports in EHRs and to having discussions about technology be a part of advance care planning. Future research should test integration in the EHR and the potential of sharing technology preferences to support person-centered technology choices.
- Open Access
- 18 March 2024
- Published by JMIR Publications Inc. in JMIR Formative Research
- Vol. 8 (1) , e50716
Use of Digital COVID-19 Exposure Notifications at a Large Gathering: Survey Analysis of Public Health Conference Attendees
Background: WA Notify was Washington State’s smartphone-based COVID-19 digital exposure notification (EN) tool, which was used to help limit the spread of COVID-19 between November 30, 2020, and May 11, 2023. Following the 2022 Washington State Public Health Association Annual Conference, attendees who had WA Notify activated began receiving ENs alerting them to a possible COVID-19 exposure during the conference. A survey was emailed to all conference attendees to measure WA Notify adoption, mechanisms through which attendees received ENs, and self-reported engagement in protective behaviors postexposure. Objective: This study aimed to learn more about the experiences of WA Notify adopters and nonadopters who may have been exposed to COVID-19 at a large group gathering. Methods: A web-based survey administered through REDCap (Research Electronic Data Capture; Vanderbilt University) was sent to all attendees of the Washington State Public Health Association conference. Self-reported demographic information and characteristics of respondents were summarized. Regression models were used to estimate relative risks to compare WA Notify adoption and testing behaviors between groups. Results: Of the 464 total registered attendees who were sent the survey, 205 (44%) responses were received; 201 eligible attendees were included in this analysis. Of those, 149 (74%) respondents reported having WA Notify activated on their phones at the time of the conference. Among respondents with WA Notify activated, 54% (n=77) reported learning of their potential exposure from a WA Notify EN. Respondents who reported that they did not have WA Notify activated and learned of their potential exposure via the event-wide email from conference organizers were 39% less likely to test for COVID-19 compared to respondents with WA Notify activated who learned of their potential exposure from the email (relative risk 0.61, 95% CI 0.40-0.93; P=.02), and this gap was even larger when compared to respondents who learned of their exposure from a WA Notify EN. The most commonly cited reason for not having WA Notify activated was privacy concerns (n=17, 35%), followed by not wanting to receive ENs (n=6, 12%) and being unaware of WA Notify (n=5, 10%). Conclusions: Digital EN systems are an important tool to directly and anonymously notify close contacts of potential exposures and provide guidance on the next steps in a timely manner. Given the privacy concerns, there is still a need for increasing transparency surrounding EN technology to increase uptake by the public if this technology were to be used in the future to slow the spread of communicable diseases.
- 18 March 2024
- Published by JMIR Publications Inc. in JMIR Formative Research
- Vol. 8 (1) , e50716
Open AccessUse of Digital COVID-19 Exposure Notifications at a Large Gathering: Survey Analysis of Public Health Conference Attendees
Background: WA Notify was Washington State’s smartphone-based COVID-19 digital exposure notification (EN) tool, which was used to help limit the spread of COVID-19 between November 30, 2020, and May 11, 2023. Following the 2022 Washington State Public Health Association Annual Conference, attendees who had WA Notify activated began receiving ENs alerting them to a possible COVID-19 exposure during the conference. A survey was emailed to all conference attendees to measure WA Notify adoption, mechanisms through which attendees received ENs, and self-reported engagement in protective behaviors postexposure. Objective: This study aimed to learn more about the experiences of WA Notify adopters and nonadopters who may have been exposed to COVID-19 at a large group gathering. Methods: A web-based survey administered through REDCap (Research Electronic Data Capture; Vanderbilt University) was sent to all attendees of the Washington State Public Health Association conference. Self-reported demographic information and characteristics of respondents were summarized. Regression models were used to estimate relative risks to compare WA Notify adoption and testing behaviors between groups. Results: Of the 464 total registered attendees who were sent the survey, 205 (44%) responses were received; 201 eligible attendees were included in this analysis. Of those, 149 (74%) respondents reported having WA Notify activated on their phones at the time of the conference. Among respondents with WA Notify activated, 54% (n=77) reported learning of their potential exposure from a WA Notify EN. Respondents who reported that they did not have WA Notify activated and learned of their potential exposure via the event-wide email from conference organizers were 39% less likely to test for COVID-19 compared to respondents with WA Notify activated who learned of their potential exposure from the email (relative risk 0.61, 95% CI 0.40-0.93; P=.02), and this gap was even larger when compared to respondents who learned of their exposure from a WA Notify EN. The most commonly cited reason for not having WA Notify activated was privacy concerns (n=17, 35%), followed by not wanting to receive ENs (n=6, 12%) and being unaware of WA Notify (n=5, 10%). Conclusions: Digital EN systems are an important tool to directly and anonymously notify close contacts of potential exposures and provide guidance on the next steps in a timely manner. Given the privacy concerns, there is still a need for increasing transparency surrounding EN technology to increase uptake by the public if this technology were to be used in the future to slow the spread of communicable diseases.
- Open Access
- 12 July 2023
- Published by JMIR Publications Inc. in JMIR Preprints
Use of Digital COVID-19 Exposure Notifications at a Large Gathering: Survey Analysis of Public Health Conference Attendees (Preprint)
BACKGROUND WA Notify was Washington State’s smartphone-based COVID-19 digital exposure notification (EN) tool, which was used to help limit the spread of COVID-19 between November 30, 2020, and May 11, 2023. Following the 2022 Washington State Public Health Association Annual Conference, attendees who had WA Notify activated began receiving ENs alerting them to a possible COVID-19 exposure during the conference. A survey was emailed to all conference attendees to measure WA Notify adoption, mechanisms through which attendees received ENs, and self-reported engagement in protective behaviors postexposure. OBJECTIVE This study aimed to learn more about the experiences of WA Notify adopters and nonadopters who may have been exposed to COVID-19 at a large group gathering. METHODS A web-based survey administered through REDCap (Research Electronic Data Capture; Vanderbilt University) was sent to all attendees of the Washington State Public Health Association conference. Self-reported demographic information and characteristics of respondents were summarized. Regression models were used to estimate relative risks to compare WA Notify adoption and testing behaviors between groups. RESULTS Of the 464 total registered attendees who were sent the survey, 205 (44%) responses were received; 201 eligible attendees were included in this analysis. Of those, 149 (74%) respondents reported having WA Notify activated on their phones at the time of the conference. Among respondents with WA Notify activated, 54% (n=77) reported learning of their potential exposure from a WA Notify EN. Respondents who reported that they did not have WA Notify activated and learned of their potential exposure via the event-wide email from conference organizers were 39% less likely to test for COVID-19 compared to respondents with WA Notify activated who learned of their potential exposure from the email (relative risk 0.61, 95% CI 0.40-0.93; P=.02), and this gap was even larger when compared to respondents who learned of their exposure from a WA Notify EN. The most commonly cited reason for not having WA Notify activated was privacy concerns (n=17, 35%), followed by not wanting to receive ENs (n=6, 12%) and being unaware of WA Notify (n=5, 10%). CONCLUSIONS Digital EN systems are an important tool to directly and anonymously notify close contacts of potential exposures and provide guidance on the next steps in a timely manner. Given the privacy concerns, there is still a need for increasing transparency surrounding EN technology to increase uptake by the public if this technology were to be used in the future to slow the spread of communicable diseases.
- 12 July 2023
- Published by JMIR Publications Inc. in JMIR Preprints
Open AccessUse of Digital COVID-19 Exposure Notifications at a Large Gathering: Survey Analysis of Public Health Conference Attendees (Preprint)
BACKGROUND WA Notify was Washington State’s smartphone-based COVID-19 digital exposure notification (EN) tool, which was used to help limit the spread of COVID-19 between November 30, 2020, and May 11, 2023. Following the 2022 Washington State Public Health Association Annual Conference, attendees who had WA Notify activated began receiving ENs alerting them to a possible COVID-19 exposure during the conference. A survey was emailed to all conference attendees to measure WA Notify adoption, mechanisms through which attendees received ENs, and self-reported engagement in protective behaviors postexposure. OBJECTIVE This study aimed to learn more about the experiences of WA Notify adopters and nonadopters who may have been exposed to COVID-19 at a large group gathering. METHODS A web-based survey administered through REDCap (Research Electronic Data Capture; Vanderbilt University) was sent to all attendees of the Washington State Public Health Association conference. Self-reported demographic information and characteristics of respondents were summarized. Regression models were used to estimate relative risks to compare WA Notify adoption and testing behaviors between groups. RESULTS Of the 464 total registered attendees who were sent the survey, 205 (44%) responses were received; 201 eligible attendees were included in this analysis. Of those, 149 (74%) respondents reported having WA Notify activated on their phones at the time of the conference. Among respondents with WA Notify activated, 54% (n=77) reported learning of their potential exposure from a WA Notify EN. Respondents who reported that they did not have WA Notify activated and learned of their potential exposure via the event-wide email from conference organizers were 39% less likely to test for COVID-19 compared to respondents with WA Notify activated who learned of their potential exposure from the email (relative risk 0.61, 95% CI 0.40-0.93; P=.02), and this gap was even larger when compared to respondents who learned of their exposure from a WA Notify EN. The most commonly cited reason for not having WA Notify activated was privacy concerns (n=17, 35%), followed by not wanting to receive ENs (n=6, 12%) and being unaware of WA Notify (n=5, 10%). CONCLUSIONS Digital EN systems are an important tool to directly and anonymously notify close contacts of potential exposures and provide guidance on the next steps in a timely manner. Given the privacy concerns, there is still a need for increasing transparency surrounding EN technology to increase uptake by the public if this technology were to be used in the future to slow the spread of communicable diseases.
- Open Access
- 16 March 2023
- Published by JMIR Publications Inc. in JMIR Formative Research
- Vol. 7, e39777
Time Utilization Among Immunization Clinics Using an Electronic Immunization Registry (Part 2): Time and Motion Study of Modified User Workflows
Background: Digital health interventions have the potential to improve the provision of health care services through digitized data collection and management. Low- and middle-income countries are beginning to introduce electronic immunization registries (EIRs) into their routine immunization services to better capture and store childhood vaccination information. Especially in Africa, where 25% of children remain unimmunized or underimmunized, technologies that can help identify children due for a vaccination are particularly important for improving vaccination coverage. However, an improved understanding of the effectiveness of these systems is needed to develop and deploy sustainable EIRs in low- and middle-income countries. Objective: We conducted an interventional pretest-posttest design study that sought to improve time efficiency through workflow modifications in Kenyan immunization clinics. Our aim was to describe how activity times differed after introducing workflow modifications that could potentially reduce the time needed to perform routine data entry activities. Our intent was to demonstrate changes in efficiency when moving from the existing dual–data entry workflow to a future paperless workflow by health facility size and experience length of health care workers (HCWs). Methods: We tested how 3 workflow modifications would affect time utilization among HCWs using the EIR at the point of care compared with baseline immunization clinic workflows. Our outcome of interest was the time taken to complete individual activities and a patient’s total time in the clinic where we compared the time spent during the baseline workflow with that during the modified workflow. We used a standardized tool to observe and document the immunization clinic workflow. To estimate differences in time utilization, we used bivariate analyses and fit multivariate linear mixed-effects models. Results: Our study found that for HCWs using an EIR, the introduction of modified workflows decreased the amount of time needed to provide services to children seen in the immunization clinic. With a baseline mean time of 10 minutes spent per child, this decreased by about 3 minutes when the preparation modification was introduced and almost 5 minutes for the paperless and combined modifications. Results pertaining to the EIR’s performance and ability to connect to the internet were particularly insightful about potential causes of delays. Conclusions: We were able to conduct a concise clinical simulation exercise by introducing modified workflows and estimating their impact on time utilization in immunization clinics using an EIR. We found that the paperless workflow provided the largest time savings when delivering services, although this was threatened by poor EIR performance and internet connectivity. This study demonstrated that not only should digital health interventions be built and adapted for particular use cases but existing user workflows also need to adapt to new technology.
- 16 March 2023
- Published by JMIR Publications Inc. in JMIR Formative Research
- Vol. 7, e39777
Open AccessTime Utilization Among Immunization Clinics Using an Electronic Immunization Registry (Part 2): Time and Motion Study of Modified User Workflows
Background: Digital health interventions have the potential to improve the provision of health care services through digitized data collection and management. Low- and middle-income countries are beginning to introduce electronic immunization registries (EIRs) into their routine immunization services to better capture and store childhood vaccination information. Especially in Africa, where 25% of children remain unimmunized or underimmunized, technologies that can help identify children due for a vaccination are particularly important for improving vaccination coverage. However, an improved understanding of the effectiveness of these systems is needed to develop and deploy sustainable EIRs in low- and middle-income countries. Objective: We conducted an interventional pretest-posttest design study that sought to improve time efficiency through workflow modifications in Kenyan immunization clinics. Our aim was to describe how activity times differed after introducing workflow modifications that could potentially reduce the time needed to perform routine data entry activities. Our intent was to demonstrate changes in efficiency when moving from the existing dual–data entry workflow to a future paperless workflow by health facility size and experience length of health care workers (HCWs). Methods: We tested how 3 workflow modifications would affect time utilization among HCWs using the EIR at the point of care compared with baseline immunization clinic workflows. Our outcome of interest was the time taken to complete individual activities and a patient’s total time in the clinic where we compared the time spent during the baseline workflow with that during the modified workflow. We used a standardized tool to observe and document the immunization clinic workflow. To estimate differences in time utilization, we used bivariate analyses and fit multivariate linear mixed-effects models. Results: Our study found that for HCWs using an EIR, the introduction of modified workflows decreased the amount of time needed to provide services to children seen in the immunization clinic. With a baseline mean time of 10 minutes spent per child, this decreased by about 3 minutes when the preparation modification was introduced and almost 5 minutes for the paperless and combined modifications. Results pertaining to the EIR’s performance and ability to connect to the internet were particularly insightful about potential causes of delays. Conclusions: We were able to conduct a concise clinical simulation exercise by introducing modified workflows and estimating their impact on time utilization in immunization clinics using an EIR. We found that the paperless workflow provided the largest time savings when delivering services, although this was threatened by poor EIR performance and internet connectivity. This study demonstrated that not only should digital health interventions be built and adapted for particular use cases but existing user workflows also need to adapt to new technology.
- Open Access
- 14 March 2023
- Published by JMIR Publications Inc. in JMIR Formative Research
- Vol. 7 (1) , e39775
Integration of a Digital Health Intervention Into Immunization Clinic Workflows in Kenya: Qualitative, Realist Evaluation of Technology Usability
Background: In an effort to increase vaccination coverage in low-resource settings, digital tools have been introduced to better track immunization records, improve data management practices, and provide improved access to vaccination coverage data for decision-making. Despite the potential of these electronic systems to improve the provision of health services, few digital health interventions have been institutionalized at scale in low- and middle-income countries. Objective: In this paper, we aimed to describe how health care workers in Kenya had integrated an electronic immunization registry into their immunization clinic workflows and to use these findings to inform the development of a refined program theory on the registry’s usability. Methods: Informed by realist methodology, we developed a program theory to explain usability of the electronic immunization registry. We designed a qualitative study based on our theory to describe the barriers and facilitators influencing data entry and use. Qualitative data were collected through semistructured interviews with users and workflow observations of immunization clinic sessions. Our findings were summarized by context-mechanism-outcome relationships formed after analyzing our key themes across interviews and workflow observations. Using these relationships, we were able to identify common rules for future implementers. Results: Across the 12 facilities included in our study, 19 health care workers were interviewed, and 58 workflow sessions were observed. The common rules developed from our qualitative findings are as follows: rule 1—ensure that the users complete training to build familiarity with the system, understand the value of the system and data, and know where to find support; rule 2—confirm that the system captures all data needed for users to provide routine health care services and is easy to navigate; rule 3—identify work-arounds for poor network, system performance, and too few staff or resources; and rule 4—make users aware of expected changes to their workflow, and how these changes might differ over time and by facility size or number of patients. Upon study completion, we revised the program theory to reflect the importance of the goals and workflows of electronic immunization registries aligning with reality. Conclusions: We created a deeper understanding of the underlying mechanisms for usability of the registry. We found that the electronic immunization registry had high acceptability among users; however, there were numerous barriers to using the system, even under ideal conditions, causing a misalignment between the system and the reality of the users’ workflows and their environment. Human-centered design and human-factors methods can assist during pilot stages to better align systems with users’ needs and again after scale-up to ensure that interventions are suitable for all user settings.
- 14 March 2023
- Published by JMIR Publications Inc. in JMIR Formative Research
- Vol. 7 (1) , e39775
Open AccessIntegration of a Digital Health Intervention Into Immunization Clinic Workflows in Kenya: Qualitative, Realist Evaluation of Technology Usability
Background: In an effort to increase vaccination coverage in low-resource settings, digital tools have been introduced to better track immunization records, improve data management practices, and provide improved access to vaccination coverage data for decision-making. Despite the potential of these electronic systems to improve the provision of health services, few digital health interventions have been institutionalized at scale in low- and middle-income countries. Objective: In this paper, we aimed to describe how health care workers in Kenya had integrated an electronic immunization registry into their immunization clinic workflows and to use these findings to inform the development of a refined program theory on the registry’s usability. Methods: Informed by realist methodology, we developed a program theory to explain usability of the electronic immunization registry. We designed a qualitative study based on our theory to describe the barriers and facilitators influencing data entry and use. Qualitative data were collected through semistructured interviews with users and workflow observations of immunization clinic sessions. Our findings were summarized by context-mechanism-outcome relationships formed after analyzing our key themes across interviews and workflow observations. Using these relationships, we were able to identify common rules for future implementers. Results: Across the 12 facilities included in our study, 19 health care workers were interviewed, and 58 workflow sessions were observed. The common rules developed from our qualitative findings are as follows: rule 1—ensure that the users complete training to build familiarity with the system, understand the value of the system and data, and know where to find support; rule 2—confirm that the system captures all data needed for users to provide routine health care services and is easy to navigate; rule 3—identify work-arounds for poor network, system performance, and too few staff or resources; and rule 4—make users aware of expected changes to their workflow, and how these changes might differ over time and by facility size or number of patients. Upon study completion, we revised the program theory to reflect the importance of the goals and workflows of electronic immunization registries aligning with reality. Conclusions: We created a deeper understanding of the underlying mechanisms for usability of the registry. We found that the electronic immunization registry had high acceptability among users; however, there were numerous barriers to using the system, even under ideal conditions, causing a misalignment between the system and the reality of the users’ workflows and their environment. Human-centered design and human-factors methods can assist during pilot stages to better align systems with users’ needs and again after scale-up to ensure that interventions are suitable for all user settings.
- Open Access
- 28 February 2023
- Published by Wiley in HIV Medicine
- Vol. 24 (6) , 703-715
Associations between alcohol and cigarette use and type 1 and 2 myocardial infarction among people with HIV
Objectives: People with HIV have a higher risk of myocardial infarction (MI) than the general population, with a greater proportion of type 2 MI (T2MI) due to oxygen demand–supply mismatch compared with type 1 (T1MI) resulting from atherothrombotic plaque disruption. People living with HIV report a greater prevalence of cigarette and alcohol use than do the general population. Alcohol use and smoking as risk factors for MI by type are not well studied among people living with HIV. We examined longitudinal associations between smoking and alcohol use patterns and MI by type among people living with HIV.Design and Methods: Using longitudinal data from the Centers for AIDS Research Network of Integrated Clinical Systems cohort, we conducted time‐updated Cox proportional hazards models to determine the impact of smoking and alcohol consumption on adjudicated T1MI and T2MI.Results: Among 13 506 people living with HIV, with a median 4 years of follow‐up, we observed 177 T1MI and 141 T2MI. Current smoking was associated with a 60% increase in risk of both T1MI and T2MI. In addition, every cigarette smoked per day was associated with a 4% increase in risk of T1MI, with a suggestive, but not significant, 2% increase for T2MI. Cigarette use had a greater impact on T1MI for men than for women and on T2MI for women than for men. Increasing alcohol use was associated with a lower risk of T1MI but not T2MI. Frequency of heavy episodic alcohol use was not associated with MI.Conclusions: Our findings reinforce the prioritization of smoking reduction, even without cessation, and cessation among people living with HIV for MI prevention and highlight the different impacts on MI type by gender.
- 28 February 2023
- Published by Wiley in HIV Medicine
- Vol. 24 (6) , 703-715
Open AccessAssociations between alcohol and cigarette use and type 1 and 2 myocardial infarction among people with HIV
Objectives: People with HIV have a higher risk of myocardial infarction (MI) than the general population, with a greater proportion of type 2 MI (T2MI) due to oxygen demand–supply mismatch compared with type 1 (T1MI) resulting from atherothrombotic plaque disruption. People living with HIV report a greater prevalence of cigarette and alcohol use than do the general population. Alcohol use and smoking as risk factors for MI by type are not well studied among people living with HIV. We examined longitudinal associations between smoking and alcohol use patterns and MI by type among people living with HIV.Design and Methods: Using longitudinal data from the Centers for AIDS Research Network of Integrated Clinical Systems cohort, we conducted time‐updated Cox proportional hazards models to determine the impact of smoking and alcohol consumption on adjudicated T1MI and T2MI.Results: Among 13 506 people living with HIV, with a median 4 years of follow‐up, we observed 177 T1MI and 141 T2MI. Current smoking was associated with a 60% increase in risk of both T1MI and T2MI. In addition, every cigarette smoked per day was associated with a 4% increase in risk of T1MI, with a suggestive, but not significant, 2% increase for T2MI. Cigarette use had a greater impact on T1MI for men than for women and on T2MI for women than for men. Increasing alcohol use was associated with a lower risk of T1MI but not T2MI. Frequency of heavy episodic alcohol use was not associated with MI.Conclusions: Our findings reinforce the prioritization of smoking reduction, even without cessation, and cessation among people living with HIV for MI prevention and highlight the different impacts on MI type by gender.