WIWilliam Brown Iii

William Brown Iii

*This is an algorithmically generated author record based on publicly available information.

Current Organizations / Institutes

The organizations/institutes from the scholar's latest article

Previous Organizations / Institutes

The organizations / institutes from the scholar's other articles in the past ten years


William Brown Iii has a total of 115 co-authors. Here are the top co-authors by number of shared publications:


Latest Publications

  • Open Access

    Large Language Model–Assisted Semiautomated Data Harmonization Pipeline for the Multiple Chronic Disease Disparities Research Consortium: Framework Development and Comparative Validation Study

    by Hyelee Kim, Shuang Liang, Kathy Lanier, Sarit Helman, Nancy F Cheng, Niloufar Ameli, Jaysón Davidson, Shivani Mehta, Yulin Hswen, Catherine E Oldenburg, et al.

    Background: The increasing availability of machine-readable research data has created a growing need for efficient large-scale data harmonization (DH). Although large language models (LLMs) show promise for reducing the time and labor required for DH, their effective integration into harmonization workflows remains an important methodological challenge. Objective: This study aims to develop and evaluate a semiautomated, human-in-the-loop (HITL) LLM-assisted DH workflow as a proof of concept across 8 projects within a research consortium focused on disparities in multiple chronic conditions. Methods: We developed an LLM-assisted DH workflow that combined preprocessing, semantic mapping, variable response mapping, synthetic data generation, data transformation, and iterative researcher review. Using Generative Pretrained Transformer (GPT-4o) hosted in a secure academic environment, project-specific survey items were mapped to 114 Consortium Common Data Element (CDE) semantic groups. Semantic mapping accuracy was evaluated based on the Consortium’s consensus harmonization results. Complete and incomplete semantic mappings were distinguished according to construct overlap, and incomplete mappings requiring context-dependent human judgment were excluded for mapped item pairs and CDE semantic groups with and without HITL review. Results: Following preprocessing, 884 survey items were included in the DH workflow, of which 812 were mapped to a mean of 79 CDE semantic groups per project. Mean semantic mapping accuracy for item pairs was 95.9% (SD 5.7%) with HITL review and 86.7% (SD 8.6%) without HITL review. At the CDE semantic-group level, the corresponding accuracies were 98.9% (SD 1.7%) and 94.9% (SD 4.0%), respectively. Across projects, omission of valid semantic mappings occurred more frequently than incorrect semantic mappings, particularly for heterogeneous response structures and subjective constructs measured using different instruments. Pipeline components—including concept-based preprocessing, iterative prompt refinement, and targeted HITL review—improved mapping completeness and supported variable harmonization across heterogeneous datasets. Conclusions: This proof-of-concept study demonstrates that the effectiveness of LLM-assisted DH depends more on the design of a structured HITL workflow rather than on the LLM alone. Combining preprocessing, iterative verification, and targeted human oversight improved the efficiency and reliability of DH while preserving researcher judgment for complex mapping decisions.

  • Bidirectional data harmonization across the multiple chronic disease disparities research consortium: A pipeline description of opportunities and challenges

    by Hyelee Kim, Shuang Liang, Kathy Lanier, Sarit Helman, Niloufar Ameli, Sepideh Banava, Nancy Fan Cheng, Jason Boyce, Yulin Hswen, Catherine E. Oldenburg, et al.


  • Common Data Element (CDE) Success from Community-Engagement Not Mandates: If You Build It [Data Warehouse], Will They [Participants] Come?

    by Stuart A. Gansky, Alex C. Cheng, Dinesh Mendhe, Aryanna Chavez, Hsin-Chieh Yeh, Kathy Lanier, William Brown, Derek E. Hersch, Elbert S. Huang, Felicity T. Enders, et al.


  • Open Access

    Building a Client Resource and Communication Platform for Community-Based Organizations to Address Health and Social Needs: Co-Design Study

    by Courtney Lyles, Beth Berrean, Ana Buenaventura, Svetlana Milter, Dayana Daniel Hernandez, Urmimala Sarkar, Christian Gutierrez, Nynikka Palmer, William Brown Iii

    Background: Connecting individuals to existing community resources is critical to addressing social needs and improving population health. While there is much ongoing informatics work embedding social needs screening and referrals into health care systems and their electronic health records, there has been less focus on the digital ecosystem and needs of community-based organizations (CBOs) providing or connecting individuals to these resources. Objective: We used human-centered design to develop a digital platform for CBOs, focused on identification of health and social resources and communication with their clients. Methods: Centered in the Develop phase of the design process, we conducted in-depth interviews in 2 phases with community-based organizational leadership and staff to create and iterate on the platform. We elicited and mapped participant feedback to theory-informed domains from the Technology Acceptance Model, such as Usefulness and Ease of Use, to build the final product and summarized all major design decisions as the platform development proceeded. Results: Overall, we completed 22 interviews with 18 community-based organizational leadership and staff in 2 consecutive Develop phases. After coding of the interview transcripts, there were 4 major themes related to usability, relevance, and external factors impacting use. Specifically, CBOs expressed an interest in a customer relationship management software to manage their client interactions and communications, and they needed specific additional features to address the scope of their everyday work, namely (1) digital and SMS text messaging communication with clients and (2) easy ways to identify relevant community resources based on diverse client needs and various program eligibility criteria. Finally, clear implementation needs emerged, such as digital training and support for staff using new platforms. The final platform, titled “Mapping to Enhance the Vitality of Engaged Neighborhoods (MAVEN),” was completed in the Salesforce environment in 2022, and it included features and functions directly mapped to the design process. Conclusions: Engaging community organizations in user-centered design of a health and social resource platform was essential to tapping into their deep expertise in serving local communities and neighborhoods. Design methods informed by behavioral theory can be similarly employed in other informatics research. Moving forward, much more work will be necessary to support the implementation of platforms specific to CBOs’ needs, especially given the resources, training, and customization needed in these settings.


  • Open Access

    Patient Engagement With and Perspectives on a Mobile Health Home Spirometry Intervention: Mixed Methods Study

    by Andrew W Liu, Iii William Brown, Ndubuisi E Madu, Ali R Maiorano, Olivia Bigazzi, Eli Medina, Christopher Sorric, Steven R Hays, Anobel Y Odisho

    Background: Patient engagement attrition in mobile health (mHealth) remote patient monitoring (RPM) programs decreases program benefits. Systemic disparities lead to inequities in RPM adoption and use. There is an urgent need to understand patients’ experiences with RPM in the real world, especially for patients who have stopped using the programs, as addressing issues faced by patients can increase the value of mHealth for patients and subsequently decrease attrition. Objective: This study sought to understand patient engagement and experiences in an RPM mHealth intervention in lung transplant recipients. Methods: Between May 4, 2020, and November 1, 2022, a total of 601 lung transplant recipients were enrolled in an mHealth RPM intervention to monitor lung function. The predictors of patient engagement were evaluated using multivariable logistic and linear regression. Semistructured interviews were conducted with 6 of 39 patients who had engaged in the first month but stopped using the program, and common themes were identified. Results: Patients who underwent transplant more than 1 year before enrollment in the program had 84% lower odds of engaging (odds ratio [OR] 0.16, 95% CI 0.07-0.35), 82% lower odds of submitting pulmonary function measurements (OR 0.18, 95% CI 0.09-0.33), and 78% lower odds of completing symptom checklists (OR 0.22, 95% CI 0.10-0.43). Patients whose primary language was not English had 78% lower odds of engaging compared to English speakers (OR 0.22, 95% CI 0.07-0.67). Interviews revealed 4 prominent themes: challenges with devices, communication breakdowns, a desire for more personal interactions and specific feedback with the care team about their results, understanding the purpose of the chat, and understanding how their data are used. Conclusions: Care delivery and patient experiences with RPM in lung transplant mHealth can be improved and made more equitable by tailoring outreach and enhancements toward non-English speakers and patients with a longer time between transplant and enrollment. Attention to designing programs to provide personalization through supplementary provider contact, education, and information transparency may decrease attrition rates.


  • Open Access

    Building a Client Resource and Communication Platform for Community-Based Organizations: Co-Design to Address Health and Social Needs (Preprint)

    by Courtney Lyles, Beth Berrean, Ana Buenaventura, Svetlana Milter, Dayana Daniel Hernandez, Urmimala Sarkar, Christian Gutierrez, Nynikka Palmer, William Brown

    BACKGROUND Connecting individuals to existing community resources is critical to addressing social needs and improving population health. While there is much ongoing informatics work embedding social needs screening and referrals into healthcare systems and their electronic health records (EHRs), there has been less focus on the digital ecosystem and needs of community-based organizations providing or connecting individuals to these resources. OBJECTIVE We used human-centered design to develop a digital platform for community-based organizations, focused on identification of health and social resources and communication with their clients. METHODS Centered in the Develop phase of the design process, we conducted in-depth interviews in two phases with community-based organizational leadership and staff to create and iterate on the platform. We mapped participant feedback to theory-informed domains from the Technology Acceptance Model, such as Usefulness and Ease of Use, to build the final product, and summarized all major design decisions as the platform development proceeded. RESULTS Overall, we completed 22 interviews with 18 community-based organizational leadership and staff in two consecutive Develop phases. After coding of the interview transcripts, there were 4 major themes related to usability, relevance, and external factors impacting use. Specifically, CBOs expressed an interest in a customer relationship management software to manage their client interactions and communications, and they needed specific additional features to address the scope of their everyday work. In addition, community-based organizations prioritized digital and text messaging communication with clients and needed easier ways to identify relevant community resources based on diverse client needs and various program eligibility criteria. Finally, clear implementation needs emerged, such as digital training and support for staff using new platforms. The ultimate platform, entitled Mapping to Enhance the Vitality of Engaged Neighborhoods (MAVEN), outlined feature changes and additions in line with these qualitative findings, including core implementation strategies for improving rollout and use. CONCLUSIONS Community organizations hold deep expertise in serving local communities and neighborhoods with resources that promote health and wellbeing. Human-centered design was well-matched for the creation of a digital platform that supports community-based organizations in connecting clients to relevant health and social resources. However, much more work will be necessary to support the implementation of platforms specific to community-based organizations’ needs, especially given the training and customization needed in these settings.


  • Open Access

    Social Determinants of Health Documentation in Structured and Unstructured Clinical Data of Patients With Diabetes: Comparative Analysis

    by Shivani Mehta, Courtney R Lyles, Anna D Rubinsky, Kathryn E Kemper, Judith Auerbach, Urmimala Sarkar, Laura Gottlieb, William Brown Iii

    Background: Electronic health records (EHRs) have yet to fully capture social determinants of health (SDOH) due to challenges such as nonexistent or inconsistent data capture tools across clinics, lack of time, and the burden of extra steps for the clinician. However, patient clinical notes (unstructured data) may be a better source of patient-related SDOH information. Objective: It is unclear how accurately EHR data reflect patients’ lived experience of SDOH. The manual process of retrieving SDOH information from clinical notes is time-consuming and not feasible. We leveraged two high-throughput tools to identify SDOH mappings to structured and unstructured patient data: PatientExploreR and Electronic Medical Record Search Engine (EMERSE). Methods: We included adult patients (≥18 years of age) receiving primary care for their diabetes at the University of California, San Francisco (UCSF), from January 1, 2018, to December 31, 2019. We used expert raters to develop a corpus using SDOH in the compendium as a knowledge base as targets for the natural language processing (NLP) text string mapping to find string stems, roots, and syntactic similarities in the clinical notes of patients with diabetes. We applied advanced built-in EMERSE NLP query parsers implemented with JavaCC. Results: We included 4283 adult patients receiving primary care for diabetes at UCSF. Our study revealed that SDOH may be more significant in the lives of patients with diabetes than is evident from structured data recorded on EHRs. With the application of EMERSE NLP rules, we uncovered additional information from patient clinical notes on problems related to social connectionsisolation, employment, financial insecurity, housing insecurity, food insecurity, education, and stress. Conclusions: We discovered more patient information related to SDOH in unstructured data than in structured data. The application of this technique and further investment in similar user-friendly tools and infrastructure to extract SDOH information from unstructured data may help to identify the range of social conditions that influence patients’ disease experiences and inform clinical decision-making.


  • Impact of an automated peri-procedural digital health intervention on rates of emergency department visits and readmissions

    by Andrew W. Liu, Logan Pierce, Smitha Ganeshan, William Brown, Timothy Judson, Dileesh Divakaran, Stefano Bini, Anobel Y. Odisho, Michelle Mourad


  • Open Access

    Patient Engagement With and Perspectives on a Mobile Health Home Spirometry Intervention: Mixed Methods Study (Preprint)

    by Andrew W Liu, Iii William Brown, Ndubuisi E Madu, Ali R Maiorano, Olivia Bigazzi, Eli Medina, Christopher Sorric, Steven R Hays, Anobel Y Odisho

    BACKGROUND Patient engagement attrition in mobile health (mHealth) remote patient monitoring (RPM) programs decreases program benefits. Systemic disparities lead to inequities in RPM adoption and use. There is an urgent need to understand patients’ experiences with RPM in the real world, especially for patients who have stopped using the programs, as addressing issues faced by patients can increase the value of mHealth for patients and subsequently decrease attrition. OBJECTIVE This study sought to understand patient engagement and experiences in an RPM mHealth intervention in lung transplant recipients. METHODS Between May 4, 2020, and November 1, 2022, a total of 601 lung transplant recipients were enrolled in an mHealth RPM intervention to monitor lung function. The predictors of patient engagement were evaluated using multivariable logistic and linear regression. Semistructured interviews were conducted with 6 of 39 patients who had engaged in the first month but stopped using the program, and common themes were identified. RESULTS Patients who underwent transplant more than 1 year before enrollment in the program had 84% lower odds of engaging (odds ratio [OR] 0.16, 95% CI 0.07-0.35), 82% lower odds of submitting pulmonary function measurements (OR 0.18, 95% CI 0.09-0.33), and 78% lower odds of completing symptom checklists (OR 0.22, 95% CI 0.10-0.43). Patients whose primary language was not English had 78% lower odds of engaging compared to English speakers (OR 0.22, 95% CI 0.07-0.67). Interviews revealed 4 prominent themes: challenges with devices, communication breakdowns, a desire for more personal interactions and specific feedback with the care team about their results, understanding the purpose of the chat, and understanding how their data are used. CONCLUSIONS Care delivery and patient experiences with RPM in lung transplant mHealth can be improved and made more equitable by tailoring outreach and enhancements toward non-English speakers and patients with a longer time between transplant and enrollment. Attention to designing programs to provide personalization through supplementary provider contact, education, and information transparency may decrease attrition rates.


  • Open Access

    Patient Experience and Feedback After Using an Electronic Health Record–Integrated COVID-19 Symptom Checker: Survey Study

    by Andrew W Liu, Anobel Y Odisho, William Brown Iii, Ralph Gonzales, Aaron B Neinstein, Timothy J Judson

    Background: Symptom checkers have been widely used during the COVID-19 pandemic to alleviate strain on health systems and offer patients a 24-7 self-service triage option. Although studies suggest that users may positively perceive web-based symptom checkers, no studies have quantified user feedback after use of an electronic health record–integrated COVID-19 symptom checker with self-scheduling functionality. Objective: In this paper, we aimed to understand user experience, user satisfaction, and user-reported alternatives to the use of a COVID-19 symptom checker with self-triage and self-scheduling functionality. Methods: We launched a patient-portal–based self-triage and self-scheduling tool in March 2020 for patients with COVID-19 symptoms, exposures, or questions. We made an optional, anonymous Qualtrics survey available to patients immediately after they completed the symptom checker. Results: Between December 16, 2021, and March 28, 2022, there were 395 unique responses to the survey. Overall, the respondents reported high satisfaction across all demographics, with a median rating of 8 out of 10 and 288/395 (47.6%) of the respondents giving a rating of 9 or 10 out of 10. User satisfaction scores were not associated with any demographic factors. The most common user-reported alternatives had the web-based tool not been available were calling the COVID-19 telephone hotline and sending a patient-portal message to their physician for advice. The ability to schedule a test online was the most important symptom checker feature for the respondents. The most common categories of user feedback were regarding other COVID-19 services (eg, telephone hotline), policies, or procedures, and requesting additional features or functionality. Conclusions: This analysis suggests that COVID-19 symptom checkers with self-triage and self-scheduling functionality may have high overall user satisfaction, regardless of user demographics. By allowing users to self-triage and self-schedule tests and visits, tools such as this may prevent unnecessary calls and messages to clinicians. Individual feedback suggested that the user experience for this type of tool is highly dependent on the organization's operational workflows for COVID-19 testing and care. This study provides insight for the implementation and improvement of COVID-19 symptom checkers to ensure high user satisfaction.