Thomas McGinn
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Previous Organizations / Institutes
The organizations / institutes from the scholar's other articles in the past ten years
Research Subjects
Research Interests
Thomas McGinn has a total of 100 co-authors. Here are the top co-authors by number of shared publications:
- Safiya Richardson
NYU Grossman School of Medicine, New York University, New York City, USA
18 shared publications - Sundas Khan
Department of Medicine, Baylor College of Medicine, Houston, TX, United States
13 shared publications - Douglas P. Barnaby
Feinstein Institutes for Medical Research, Northwell Health, Manhasset, NY, United States
6 shared publications - Jeffrey Solomon
Feinstein Institutes for Medical Research, Northwell Health, 600 Community Drive, Suite 403, Manhasset, NY, 11030, United States, 1 5166001421
6 shared publications - Katherine L. Dauber-Decker
Feinstein Institutes for Medical Research, Northwell Health, 600 Community Drive, Suite 403, Manhasset, NY, 11030, United States, 1 5166001421
6 shared publications - Lauren McCullagh
Donald and Barbara Zucker School of Medicine at Hofstra/Northwell Hempstead, NY United States
6 shared publications
Latest Publications
- Open Access
- 19 October 2023
- Published by JMIR Publications Inc. in JMIR Formative Research
- Vol. 7 (1) , e44065
Integrating Clinical Decision Support Into Electronic Health Record Systems Using a Novel Platform (EvidencePoint): Developmental Study
Background: Through our work, we have demonstrated how clinical decision support (CDS) tools integrated into the electronic health record (EHR) assist providers in adopting evidence-based practices. This requires confronting technical challenges that result from relying on the EHR as the foundation for tool development; for example, the individual CDS tools need to be built independently for each different EHR. Objective: The objective of our research was to build and implement an EHR-agnostic platform for integrating CDS tools, which would remove the technical constraints inherent in relying on the EHR as the foundation and enable a single set of CDS tools that can work with any EHR. Methods: We developed EvidencePoint, a novel, cloud-based, EHR-agnostic CDS platform, and we will describe the development of EvidencePoint and the deployment of its initial CDS tools, which include EHR-integrated applications for clinical use cases such as prediction of hospitalization survival for patients with COVID-19, venous thromboembolism prophylaxis, and pulmonary embolism diagnosis. Results: The results below highlight the adoption of the CDS tools, the International Medical Prevention Registry on Venous Thromboembolism-D-Dimer, the Wells’ criteria, and the Northwell COVID-19 Survival (NOCOS), following development, usability testing, and implementation. The International Medical Prevention Registry on Venous Thromboembolism-D-Dimer CDS was used in 5249 patients at the 2 clinical intervention sites. The intervention group tool adoption was 77.8% (4083/5249 possible uses). For the NOCOS tool, which was designed to assist with triaging patients with COVID-19 for hospital admission in the event of constrained hospital resources, the worst-case resourcing scenario never materialized and triaging was never required. As a result, the NOCOS tool was not frequently used, though the EvidencePoint platform’s flexibility and customizability enabled the tool to be developed and deployed rapidly under the emergency conditions of the pandemic. Adoption rates for the Wells’ criteria tool will be reported in a future publication. Conclusions: The EvidencePoint system successfully demonstrated that a flexible, user-friendly platform for hosting CDS tools outside of a specific EHR is feasible. The forthcoming results of our outcomes analyses will demonstrate the adoption rate of EvidencePoint tools as well as the impact of behavioral economics “nudges” on the adoption rate. Due to the EHR-agnostic nature of EvidencePoint, the development process for additional forms of CDS will be simpler than traditional and cumbersome IT integration approaches and will benefit from the capabilities provided by the core system of EvidencePoint.
- 19 October 2023
- Published by JMIR Publications Inc. in JMIR Formative Research
- Vol. 7 (1) , e44065
Open AccessIntegrating Clinical Decision Support Into Electronic Health Record Systems Using a Novel Platform (EvidencePoint): Developmental Study
Background: Through our work, we have demonstrated how clinical decision support (CDS) tools integrated into the electronic health record (EHR) assist providers in adopting evidence-based practices. This requires confronting technical challenges that result from relying on the EHR as the foundation for tool development; for example, the individual CDS tools need to be built independently for each different EHR. Objective: The objective of our research was to build and implement an EHR-agnostic platform for integrating CDS tools, which would remove the technical constraints inherent in relying on the EHR as the foundation and enable a single set of CDS tools that can work with any EHR. Methods: We developed EvidencePoint, a novel, cloud-based, EHR-agnostic CDS platform, and we will describe the development of EvidencePoint and the deployment of its initial CDS tools, which include EHR-integrated applications for clinical use cases such as prediction of hospitalization survival for patients with COVID-19, venous thromboembolism prophylaxis, and pulmonary embolism diagnosis. Results: The results below highlight the adoption of the CDS tools, the International Medical Prevention Registry on Venous Thromboembolism-D-Dimer, the Wells’ criteria, and the Northwell COVID-19 Survival (NOCOS), following development, usability testing, and implementation. The International Medical Prevention Registry on Venous Thromboembolism-D-Dimer CDS was used in 5249 patients at the 2 clinical intervention sites. The intervention group tool adoption was 77.8% (4083/5249 possible uses). For the NOCOS tool, which was designed to assist with triaging patients with COVID-19 for hospital admission in the event of constrained hospital resources, the worst-case resourcing scenario never materialized and triaging was never required. As a result, the NOCOS tool was not frequently used, though the EvidencePoint platform’s flexibility and customizability enabled the tool to be developed and deployed rapidly under the emergency conditions of the pandemic. Adoption rates for the Wells’ criteria tool will be reported in a future publication. Conclusions: The EvidencePoint system successfully demonstrated that a flexible, user-friendly platform for hosting CDS tools outside of a specific EHR is feasible. The forthcoming results of our outcomes analyses will demonstrate the adoption rate of EvidencePoint tools as well as the impact of behavioral economics “nudges” on the adoption rate. Due to the EHR-agnostic nature of EvidencePoint, the development process for additional forms of CDS will be simpler than traditional and cumbersome IT integration approaches and will benefit from the capabilities provided by the core system of EvidencePoint.
- Open Access
- 18 January 2023
- Published by JMIR Publications Inc. in JMIR Research Protocols
- Vol. 12 (1) , e42653
Nudging Health Care Providers’ Adoption of Clinical Decision Support: Protocol for the User-Centered Development of a Behavioral Economics–Inspired Electronic Health Record Tool
Background: The improvements in care resulting from clinical decision support (CDS) have been significantly limited by consistently low health care provider adoption. Health care provider attitudes toward CDS, specifically psychological and behavioral barriers, are not typically addressed during any stage of CDS development, although they represent an important barrier to adoption. Emerging evidence has shown the surprising power of using insights from the field of behavioral economics to address psychological and behavioral barriers. Nudges are formal applications of behavioral economics, defined as positive reinforcement and indirect suggestions that have a nonforced effect on decision-making. Objective: Our goal is to employ a user-centered design process to develop a CDS tool—the pulmonary embolism (PE) risk calculator—for PE risk stratification in the emergency department that incorporates a behavior theory–informed nudge to address identified behavioral barriers to use. Methods: All study activities took place at a large academic health system in the New York City metropolitan area. Our study used a user-centered and behavior theory–based approach to achieve the following two aims: (1) use mixed methods to identify health care provider barriers to the use of an active CDS tool for PE risk stratification and (2) develop a new CDS tool—the PE risk calculator—that addresses behavioral barriers to health care providers’ adoption of CDS by incorporating nudges into the user interface. These aims were guided by the revised Observational Research Behavioral Information Technology model. A total of 50 clinicians who used the original version of the tool were surveyed with a quantitative instrument that we developed based on a behavior theory framework—the Capability-Opportunity-Motivation-Behavior framework. A semistructured interview guide was developed based on the survey responses. Inductive methods were used to analyze interview session notes and audio recordings from 12 interviews. Revised versions of the tool were developed that incorporated nudges. Results: Functional prototypes were developed by using Axure PRO (Axure Software Solutions) software and usability tested with end users in an iterative agile process (n=10). The tool was redesigned to address 4 identified major barriers to tool use; we included 2 nudges and a default. The 6-month pilot trial for the tool was launched on October 1, 2021. Conclusions: Clinicians highlighted several important psychological and behavioral barriers to CDS use. Addressing these barriers, along with conducting traditional usability testing, facilitated the development of a tool with greater potential to transform clinical care. The tool will be tested in a prospective pilot trial. International Registered Report Identifier (IRRID): DERR1-10.2196/42653
- 18 January 2023
- Published by JMIR Publications Inc. in JMIR Research Protocols
- Vol. 12 (1) , e42653
Open AccessNudging Health Care Providers’ Adoption of Clinical Decision Support: Protocol for the User-Centered Development of a Behavioral Economics–Inspired Electronic Health Record Tool
Background: The improvements in care resulting from clinical decision support (CDS) have been significantly limited by consistently low health care provider adoption. Health care provider attitudes toward CDS, specifically psychological and behavioral barriers, are not typically addressed during any stage of CDS development, although they represent an important barrier to adoption. Emerging evidence has shown the surprising power of using insights from the field of behavioral economics to address psychological and behavioral barriers. Nudges are formal applications of behavioral economics, defined as positive reinforcement and indirect suggestions that have a nonforced effect on decision-making. Objective: Our goal is to employ a user-centered design process to develop a CDS tool—the pulmonary embolism (PE) risk calculator—for PE risk stratification in the emergency department that incorporates a behavior theory–informed nudge to address identified behavioral barriers to use. Methods: All study activities took place at a large academic health system in the New York City metropolitan area. Our study used a user-centered and behavior theory–based approach to achieve the following two aims: (1) use mixed methods to identify health care provider barriers to the use of an active CDS tool for PE risk stratification and (2) develop a new CDS tool—the PE risk calculator—that addresses behavioral barriers to health care providers’ adoption of CDS by incorporating nudges into the user interface. These aims were guided by the revised Observational Research Behavioral Information Technology model. A total of 50 clinicians who used the original version of the tool were surveyed with a quantitative instrument that we developed based on a behavior theory framework—the Capability-Opportunity-Motivation-Behavior framework. A semistructured interview guide was developed based on the survey responses. Inductive methods were used to analyze interview session notes and audio recordings from 12 interviews. Revised versions of the tool were developed that incorporated nudges. Results: Functional prototypes were developed by using Axure PRO (Axure Software Solutions) software and usability tested with end users in an iterative agile process (n=10). The tool was redesigned to address 4 identified major barriers to tool use; we included 2 nudges and a default. The 6-month pilot trial for the tool was launched on October 1, 2021. Conclusions: Clinicians highlighted several important psychological and behavioral barriers to CDS use. Addressing these barriers, along with conducting traditional usability testing, facilitated the development of a tool with greater potential to transform clinical care. The tool will be tested in a prospective pilot trial. International Registered Report Identifier (IRRID): DERR1-10.2196/42653
- Open Access
- 4 November 2022
- Published by JMIR Publications Inc. in JMIR Preprints
Integrating Clinical Decision Support Into Electronic Health Record Systems Using a Novel Platform (EvidencePoint): Developmental Study (Preprint)
BACKGROUND Through our work, we have demonstrated how clinical decision support (CDS) tools integrated into the electronic health record (EHR) assist providers in adopting evidence-based practices. This requires confronting technical challenges that result from relying on the EHR as the foundation for tool development; for example, the individual CDS tools need to be built independently for each different EHR. OBJECTIVE The objective of our research was to build and implement an EHR-agnostic platform for integrating CDS tools, which would remove the technical constraints inherent in relying on the EHR as the foundation and enable a single set of CDS tools that can work with any EHR. METHODS We developed EvidencePoint, a novel, cloud-based, EHR-agnostic CDS platform, and we will describe the development of EvidencePoint and the deployment of its initial CDS tools, which include EHR-integrated applications for clinical use cases such as prediction of hospitalization survival for patients with COVID-19, venous thromboembolism prophylaxis, and pulmonary embolism diagnosis. RESULTS The results below highlight the adoption of the CDS tools, the International Medical Prevention Registry on Venous Thromboembolism-D-Dimer, the Wells’ criteria, and the Northwell COVID-19 Survival (NOCOS), following development, usability testing, and implementation. The International Medical Prevention Registry on Venous Thromboembolism-D-Dimer CDS was used in 5249 patients at the 2 clinical intervention sites. The intervention group tool adoption was 77.8% (4083/5249 possible uses). For the NOCOS tool, which was designed to assist with triaging patients with COVID-19 for hospital admission in the event of constrained hospital resources, the worst-case resourcing scenario never materialized and triaging was never required. As a result, the NOCOS tool was not frequently used, though the EvidencePoint platform’s flexibility and customizability enabled the tool to be developed and deployed rapidly under the emergency conditions of the pandemic. Adoption rates for the Wells’ criteria tool will be reported in a future publication. CONCLUSIONS The EvidencePoint system successfully demonstrated that a flexible, user-friendly platform for hosting CDS tools outside of a specific EHR is feasible. The forthcoming results of our outcomes analyses will demonstrate the adoption rate of EvidencePoint tools as well as the impact of behavioral economics “nudges” on the adoption rate. Due to the EHR-agnostic nature of EvidencePoint, the development process for additional forms of CDS will be simpler than traditional and cumbersome IT integration approaches and will benefit from the capabilities provided by the core system of EvidencePoint.
- 4 November 2022
- Published by JMIR Publications Inc. in JMIR Preprints
Open AccessIntegrating Clinical Decision Support Into Electronic Health Record Systems Using a Novel Platform (EvidencePoint): Developmental Study (Preprint)
BACKGROUND Through our work, we have demonstrated how clinical decision support (CDS) tools integrated into the electronic health record (EHR) assist providers in adopting evidence-based practices. This requires confronting technical challenges that result from relying on the EHR as the foundation for tool development; for example, the individual CDS tools need to be built independently for each different EHR. OBJECTIVE The objective of our research was to build and implement an EHR-agnostic platform for integrating CDS tools, which would remove the technical constraints inherent in relying on the EHR as the foundation and enable a single set of CDS tools that can work with any EHR. METHODS We developed EvidencePoint, a novel, cloud-based, EHR-agnostic CDS platform, and we will describe the development of EvidencePoint and the deployment of its initial CDS tools, which include EHR-integrated applications for clinical use cases such as prediction of hospitalization survival for patients with COVID-19, venous thromboembolism prophylaxis, and pulmonary embolism diagnosis. RESULTS The results below highlight the adoption of the CDS tools, the International Medical Prevention Registry on Venous Thromboembolism-D-Dimer, the Wells’ criteria, and the Northwell COVID-19 Survival (NOCOS), following development, usability testing, and implementation. The International Medical Prevention Registry on Venous Thromboembolism-D-Dimer CDS was used in 5249 patients at the 2 clinical intervention sites. The intervention group tool adoption was 77.8% (4083/5249 possible uses). For the NOCOS tool, which was designed to assist with triaging patients with COVID-19 for hospital admission in the event of constrained hospital resources, the worst-case resourcing scenario never materialized and triaging was never required. As a result, the NOCOS tool was not frequently used, though the EvidencePoint platform’s flexibility and customizability enabled the tool to be developed and deployed rapidly under the emergency conditions of the pandemic. Adoption rates for the Wells’ criteria tool will be reported in a future publication. CONCLUSIONS The EvidencePoint system successfully demonstrated that a flexible, user-friendly platform for hosting CDS tools outside of a specific EHR is feasible. The forthcoming results of our outcomes analyses will demonstrate the adoption rate of EvidencePoint tools as well as the impact of behavioral economics “nudges” on the adoption rate. Due to the EHR-agnostic nature of EvidencePoint, the development process for additional forms of CDS will be simpler than traditional and cumbersome IT integration approaches and will benefit from the capabilities provided by the core system of EvidencePoint.
- Open Access
- 14 September 2022
- Published by JMIR Publications Inc. in JMIR Preprints
Nudging Provider Adoption of Clinical Decision Support: User-Centered Development of a Behavioral Economic-Inspired Electronic Health Record Tool (Preprint)
BACKGROUND The improvements in care seen with clinical decision support (CDS) have been significantly limited by consistently low provider adoption. Provider attitudes towards CDS, specifically psychological and behavioral barriers, are not typically addressed during any stage of CDS development although they represent an important barrier to adoption. Emerging evidence has shown the surprising power of using insights from the field of behavioral economics to address psychological and behavioral barriers. “Nudges” are a formal application of behavioral economics, defined as positive reinforcement and indirect suggestions which have a non-forced effect on decision making. OBJECTIVE Our goal was to employ a user-centered design process to develop a CDS tool, pulmonary embolism risk calculator (PERK), for pulmonary embolism (PE) risk stratification in the Emergency Department (ED) that would incorporate a behavioral theory-informed “nudge” to address identified behavioral barriers to use. METHODS All study activities took place at a large academic health system in the New York City metropolitan area. This study uses a user-centered and behavioral theory-based approach to achieve two aims: 1. Use mixed methodology to identify provider barriers to use of an active CDS tool for PE risk stratification, 2. Develop a new CDS tool, PERK, which addresses behavioral barriers to provider adoption of CDS by incorporating nudges into the user interface. These aims were guided by the revised ORBIT model. Clinicians using the original version of the tool were surveyed with a quantitative instrument based on a behavior theory framework, Capability Opportunity Motivation Behavior (n=50). A semi-structured interview guide was developed based on survey responses. Inductive methods were used to analyze interview session notes and audio recordings (n=12). Revised versions of the tool were developed that incorporated nudges. RESULTS Functional prototypes were developed using Axure PRO software and usability tested with end users in an iterative agile process (n=10). The tool was redesigned to address four major barriers identified to tool use, including two nudges and a default. CONCLUSIONS Clinicians highlighted several important psychological and behavioral barriers to CDS use. Addressing these barriers, along with traditional usability testing, facilitated the development of a tool with greater potential to transform clinical care. The tool will be tested in a prospective pilot trial.
- 14 September 2022
- Published by JMIR Publications Inc. in JMIR Preprints
Open AccessNudging Provider Adoption of Clinical Decision Support: User-Centered Development of a Behavioral Economic-Inspired Electronic Health Record Tool (Preprint)
BACKGROUND The improvements in care seen with clinical decision support (CDS) have been significantly limited by consistently low provider adoption. Provider attitudes towards CDS, specifically psychological and behavioral barriers, are not typically addressed during any stage of CDS development although they represent an important barrier to adoption. Emerging evidence has shown the surprising power of using insights from the field of behavioral economics to address psychological and behavioral barriers. “Nudges” are a formal application of behavioral economics, defined as positive reinforcement and indirect suggestions which have a non-forced effect on decision making. OBJECTIVE Our goal was to employ a user-centered design process to develop a CDS tool, pulmonary embolism risk calculator (PERK), for pulmonary embolism (PE) risk stratification in the Emergency Department (ED) that would incorporate a behavioral theory-informed “nudge” to address identified behavioral barriers to use. METHODS All study activities took place at a large academic health system in the New York City metropolitan area. This study uses a user-centered and behavioral theory-based approach to achieve two aims: 1. Use mixed methodology to identify provider barriers to use of an active CDS tool for PE risk stratification, 2. Develop a new CDS tool, PERK, which addresses behavioral barriers to provider adoption of CDS by incorporating nudges into the user interface. These aims were guided by the revised ORBIT model. Clinicians using the original version of the tool were surveyed with a quantitative instrument based on a behavior theory framework, Capability Opportunity Motivation Behavior (n=50). A semi-structured interview guide was developed based on survey responses. Inductive methods were used to analyze interview session notes and audio recordings (n=12). Revised versions of the tool were developed that incorporated nudges. RESULTS Functional prototypes were developed using Axure PRO software and usability tested with end users in an iterative agile process (n=10). The tool was redesigned to address four major barriers identified to tool use, including two nudges and a default. CONCLUSIONS Clinicians highlighted several important psychological and behavioral barriers to CDS use. Addressing these barriers, along with traditional usability testing, facilitated the development of a tool with greater potential to transform clinical care. The tool will be tested in a prospective pilot trial.
- Open Access
- 8 March 2022
- Published by Ubiquity Press, Ltd. in Annals of Global Health
- Vol. 88 (1) , 18
Fulminant and Non-fulminant Clinical COVID-19 Myocarditis in the New York City Area in 2020
COVID-19 myocarditis is becoming increasingly appreciated as a complication of COVID-19. There are significant hurdles to formal diagnosis with endomyocardial biopsy or cardiac MRI, whether by resource limitations, patient instability, or isolation precautions. Therefore, further exploratory analysis is needed to clinically define the characteristics and spectrum of severity of COVID-19 myocarditis. The aim of this study was to describe the clinical course, echocardiographic, and laboratory testing across suspected fulminant and non-fulminant clinically defined COVID-19 myocarditis. In a cross-sectional observational study of 19 patients with clinically defined COVID-19 myocarditis, we report presenting symptoms, clinical course, laboratory findings, and echocardiographic results stratified by non-fulminant and fulminant myocarditis. Student t-test and univariate logistic regression are used to compare laboratory findings across fulminant and non-fulminant cases. Among 19 patients, there was no prior history of coronary artery disease, atrial fibrillation, or heart failure; 21.1% of patients died; and 78.9% of cases required supplemental oxygen. A significantly higher geometric mean D-dimer and ferritin were observed in patients with fulminant compared to non-fulminant suspected myocarditis. 26.3% of cases had pericardial effusions. 10 out of the 16 with available echocardiographic data had normal left ventricular systolic function. In this study, we provide a practical clinical depiction of patients with clinical COVID-19 myocarditis across fulminant and non-fulminant cases. Statistically significant elevations in inflammatory markers in fulminant versus non-fulminant cases generate hypotheses regarding the role of systemic inflammation. While cardiac MRI and endomyocardial biopsy may not be accessible at scale in low- and middle-income countries, the present study offers a clinical definition of COVID-19 myocarditis and accessible laboratory findings to define severity.
- 8 March 2022
- Published by Ubiquity Press, Ltd. in Annals of Global Health
- Vol. 88 (1) , 18
Open AccessFulminant and Non-fulminant Clinical COVID-19 Myocarditis in the New York City Area in 2020
COVID-19 myocarditis is becoming increasingly appreciated as a complication of COVID-19. There are significant hurdles to formal diagnosis with endomyocardial biopsy or cardiac MRI, whether by resource limitations, patient instability, or isolation precautions. Therefore, further exploratory analysis is needed to clinically define the characteristics and spectrum of severity of COVID-19 myocarditis. The aim of this study was to describe the clinical course, echocardiographic, and laboratory testing across suspected fulminant and non-fulminant clinically defined COVID-19 myocarditis. In a cross-sectional observational study of 19 patients with clinically defined COVID-19 myocarditis, we report presenting symptoms, clinical course, laboratory findings, and echocardiographic results stratified by non-fulminant and fulminant myocarditis. Student t-test and univariate logistic regression are used to compare laboratory findings across fulminant and non-fulminant cases. Among 19 patients, there was no prior history of coronary artery disease, atrial fibrillation, or heart failure; 21.1% of patients died; and 78.9% of cases required supplemental oxygen. A significantly higher geometric mean D-dimer and ferritin were observed in patients with fulminant compared to non-fulminant suspected myocarditis. 26.3% of cases had pericardial effusions. 10 out of the 16 with available echocardiographic data had normal left ventricular systolic function. In this study, we provide a practical clinical depiction of patients with clinical COVID-19 myocarditis across fulminant and non-fulminant cases. Statistically significant elevations in inflammatory markers in fulminant versus non-fulminant cases generate hypotheses regarding the role of systemic inflammation. While cardiac MRI and endomyocardial biopsy may not be accessible at scale in low- and middle-income countries, the present study offers a clinical definition of COVID-19 myocarditis and accessible laboratory findings to define severity.
- Open Access
- 28 February 2022
- Published by JMIR Publications Inc. in JMIR Formative Research
- Vol. 6 (2) , e32230
Automated Pulmonary Embolism Risk Assessment Using the Wells Criteria: Validation Study
Background: Computed tomography pulmonary angiography (CTPA) is frequently used in the emergency department (ED) for the diagnosis of pulmonary embolism (PE), while posing risk for contrast-induced nephropathy and radiation-induced malignancy. Objective: We aimed to create an automated process to calculate the Wells score for pulmonary embolism for patients in the ED, which could potentially reduce unnecessary CTPA testing. Methods: We designed an automated process using electronic health records data elements, including using a combinatorial keyword search method to query free-text fields, and calculated automated Wells scores for a sample of all adult ED encounters that resulted in a CTPA study for PE at 2 tertiary care hospitals in New York, over a 2-month period. To validate the automated process, the scores were compared to those derived from a 2-clinician chart review. Results: A total of 202 ED encounters resulted in a completed CTPA to form the retrospective study cohort. Patients classified as “PE likely” by the automated process (126/202, 62%) had a PE prevalence of 15.9%, whereas those classified as “PE unlikely” (76/202, 38%; Wells score >4) had a PE prevalence of 7.9%. With respect to classification of the patient as “PE likely,” the automated process achieved an accuracy of 92.1% when compared with the chart review, with sensitivity, specificity, positive predictive value, and negative predictive value of 93%, 90.5%, 94.4%, and 88.2%, respectively. Conclusions: This was a successful development and validation of an automated process using electronic health records data elements, including free-text fields, to classify risk for PE in ED visits.
- 28 February 2022
- Published by JMIR Publications Inc. in JMIR Formative Research
- Vol. 6 (2) , e32230
Open AccessAutomated Pulmonary Embolism Risk Assessment Using the Wells Criteria: Validation Study
Background: Computed tomography pulmonary angiography (CTPA) is frequently used in the emergency department (ED) for the diagnosis of pulmonary embolism (PE), while posing risk for contrast-induced nephropathy and radiation-induced malignancy. Objective: We aimed to create an automated process to calculate the Wells score for pulmonary embolism for patients in the ED, which could potentially reduce unnecessary CTPA testing. Methods: We designed an automated process using electronic health records data elements, including using a combinatorial keyword search method to query free-text fields, and calculated automated Wells scores for a sample of all adult ED encounters that resulted in a CTPA study for PE at 2 tertiary care hospitals in New York, over a 2-month period. To validate the automated process, the scores were compared to those derived from a 2-clinician chart review. Results: A total of 202 ED encounters resulted in a completed CTPA to form the retrospective study cohort. Patients classified as “PE likely” by the automated process (126/202, 62%) had a PE prevalence of 15.9%, whereas those classified as “PE unlikely” (76/202, 38%; Wells score >4) had a PE prevalence of 7.9%. With respect to classification of the patient as “PE likely,” the automated process achieved an accuracy of 92.1% when compared with the chart review, with sensitivity, specificity, positive predictive value, and negative predictive value of 93%, 90.5%, 94.4%, and 88.2%, respectively. Conclusions: This was a successful development and validation of an automated process using electronic health records data elements, including free-text fields, to classify risk for PE in ED visits.
- Open Access
- 4 August 2021
- Published by JMIR Publications Inc. in JMIR Human Factors
- Vol. 8 (3) , e25046
Barriers to the Use of Clinical Decision Support for the Evaluation of Pulmonary Embolism: Qualitative Interview Study
Background: Clinicians often disregard potentially beneficial clinical decision support (CDS). Objective: In this study, we sought to explore the psychological and behavioral barriers to the use of a CDS tool. Methods: We conducted a qualitative study involving emergency medicine physicians and physician assistants. A semistructured interview guide was created based on the Capability, Opportunity, and Motivation-Behavior model. Interviews focused on the barriers to the use of a CDS tool built based on Wells’ criteria for pulmonary embolism to assist clinicians in establishing pretest probability of pulmonary embolism before imaging. Results: Interviews were conducted with 12 clinicians. Six barriers were identified, including (1) Bayesian reasoning, (2) fear of missing a pulmonary embolism, (3) time pressure or cognitive load, (4) gestalt includes Wells’ criteria, (5) missed risk factors, and (6) social pressure. Conclusions: Clinicians highlighted several important psychological and behavioral barriers to CDS use. Addressing these barriers will be paramount in developing CDS that can meet its potential to transform clinical care.
- 4 August 2021
- Published by JMIR Publications Inc. in JMIR Human Factors
- Vol. 8 (3) , e25046
Open AccessBarriers to the Use of Clinical Decision Support for the Evaluation of Pulmonary Embolism: Qualitative Interview Study
Background: Clinicians often disregard potentially beneficial clinical decision support (CDS). Objective: In this study, we sought to explore the psychological and behavioral barriers to the use of a CDS tool. Methods: We conducted a qualitative study involving emergency medicine physicians and physician assistants. A semistructured interview guide was created based on the Capability, Opportunity, and Motivation-Behavior model. Interviews focused on the barriers to the use of a CDS tool built based on Wells’ criteria for pulmonary embolism to assist clinicians in establishing pretest probability of pulmonary embolism before imaging. Results: Interviews were conducted with 12 clinicians. Six barriers were identified, including (1) Bayesian reasoning, (2) fear of missing a pulmonary embolism, (3) time pressure or cognitive load, (4) gestalt includes Wells’ criteria, (5) missed risk factors, and (6) social pressure. Conclusions: Clinicians highlighted several important psychological and behavioral barriers to CDS use. Addressing these barriers will be paramount in developing CDS that can meet its potential to transform clinical care.
- Open Access
- 22 July 2021
- Published by JMIR Publications Inc. in JMIR Preprints
Automated Pulmonary Embolism Risk Assessment Using the Wells Criteria: Validation Study (Preprint)
BACKGROUND Computed tomography pulmonary angiography (CTPA) is frequently used in the emergency department (ED) for the diagnosis of pulmonary embolism (PE), while posing risk for contrast-induced nephropathy and radiation-induced malignancy. OBJECTIVE We aimed to create an automated process to calculate the Wells score for pulmonary embolism for patients in the ED, which could potentially reduce unnecessary CTPA testing. METHODS We designed an automated process using electronic health records data elements, including using a combinatorial keyword search method to query free-text fields, and calculated automated Wells scores for a sample of all adult ED encounters that resulted in a CTPA study for PE at 2 tertiary care hospitals in New York, over a 2-month period. To validate the automated process, the scores were compared to those derived from a 2-clinician chart review. RESULTS A total of 202 ED encounters resulted in a completed CTPA to form the retrospective study cohort. Patients classified as “PE likely” by the automated process (126/202, 62%) had a PE prevalence of 15.9%, whereas those classified as “PE unlikely” (76/202, 38%; Wells score >4) had a PE prevalence of 7.9%. With respect to classification of the patient as “PE likely,” the automated process achieved an accuracy of 92.1% when compared with the chart review, with sensitivity, specificity, positive predictive value, and negative predictive value of 93%, 90.5%, 94.4%, and 88.2%, respectively. CONCLUSIONS This was a successful development and validation of an automated process using electronic health records data elements, including free-text fields, to classify risk for PE in ED visits.
- 22 July 2021
- Published by JMIR Publications Inc. in JMIR Preprints
Open AccessAutomated Pulmonary Embolism Risk Assessment Using the Wells Criteria: Validation Study (Preprint)
BACKGROUND Computed tomography pulmonary angiography (CTPA) is frequently used in the emergency department (ED) for the diagnosis of pulmonary embolism (PE), while posing risk for contrast-induced nephropathy and radiation-induced malignancy. OBJECTIVE We aimed to create an automated process to calculate the Wells score for pulmonary embolism for patients in the ED, which could potentially reduce unnecessary CTPA testing. METHODS We designed an automated process using electronic health records data elements, including using a combinatorial keyword search method to query free-text fields, and calculated automated Wells scores for a sample of all adult ED encounters that resulted in a CTPA study for PE at 2 tertiary care hospitals in New York, over a 2-month period. To validate the automated process, the scores were compared to those derived from a 2-clinician chart review. RESULTS A total of 202 ED encounters resulted in a completed CTPA to form the retrospective study cohort. Patients classified as “PE likely” by the automated process (126/202, 62%) had a PE prevalence of 15.9%, whereas those classified as “PE unlikely” (76/202, 38%; Wells score >4) had a PE prevalence of 7.9%. With respect to classification of the patient as “PE likely,” the automated process achieved an accuracy of 92.1% when compared with the chart review, with sensitivity, specificity, positive predictive value, and negative predictive value of 93%, 90.5%, 94.4%, and 88.2%, respectively. CONCLUSIONS This was a successful development and validation of an automated process using electronic health records data elements, including free-text fields, to classify risk for PE in ED visits.
- Open Access
- 10 February 2021
- Published by JMIR Publications Inc. in Journal of Medical Internet Research
- Vol. 23 (2) , e24246
A Machine Learning Prediction Model of Respiratory Failure Within 48 Hours of Patient Admission for COVID-19: Model Development and Validation
Background: Predicting early respiratory failure due to COVID-19 can help triage patients to higher levels of care, allocate scarce resources, and reduce morbidity and mortality by appropriately monitoring and treating the patients at greatest risk for deterioration. Given the complexity of COVID-19, machine learning approaches may support clinical decision making for patients with this disease. Objective: Our objective is to derive a machine learning model that predicts respiratory failure within 48 hours of admission based on data from the emergency department. Methods: Data were collected from patients with COVID-19 who were admitted to Northwell Health acute care hospitals and were discharged, died, or spent a minimum of 48 hours in the hospital between March 1 and May 11, 2020. Of 11,525 patients, 933 (8.1%) were placed on invasive mechanical ventilation within 48 hours of admission. Variables used by the models included clinical and laboratory data commonly collected in the emergency department. We trained and validated three predictive models (two based on XGBoost and one that used logistic regression) using cross-hospital validation. We compared model performance among all three models as well as an established early warning score (Modified Early Warning Score) using receiver operating characteristic curves, precision-recall curves, and other metrics. Results: The XGBoost model had the highest mean accuracy (0.919; area under the curve=0.77), outperforming the other two models as well as the Modified Early Warning Score. Important predictor variables included the type of oxygen delivery used in the emergency department, patient age, Emergency Severity Index level, respiratory rate, serum lactate, and demographic characteristics. Conclusions: The XGBoost model had high predictive accuracy, outperforming other early warning scores. The clinical plausibility and predictive ability of XGBoost suggest that the model could be used to predict 48-hour respiratory failure in admitted patients with COVID-19.
- 10 February 2021
- Published by JMIR Publications Inc. in Journal of Medical Internet Research
- Vol. 23 (2) , e24246
Open AccessA Machine Learning Prediction Model of Respiratory Failure Within 48 Hours of Patient Admission for COVID-19: Model Development and Validation
Background: Predicting early respiratory failure due to COVID-19 can help triage patients to higher levels of care, allocate scarce resources, and reduce morbidity and mortality by appropriately monitoring and treating the patients at greatest risk for deterioration. Given the complexity of COVID-19, machine learning approaches may support clinical decision making for patients with this disease. Objective: Our objective is to derive a machine learning model that predicts respiratory failure within 48 hours of admission based on data from the emergency department. Methods: Data were collected from patients with COVID-19 who were admitted to Northwell Health acute care hospitals and were discharged, died, or spent a minimum of 48 hours in the hospital between March 1 and May 11, 2020. Of 11,525 patients, 933 (8.1%) were placed on invasive mechanical ventilation within 48 hours of admission. Variables used by the models included clinical and laboratory data commonly collected in the emergency department. We trained and validated three predictive models (two based on XGBoost and one that used logistic regression) using cross-hospital validation. We compared model performance among all three models as well as an established early warning score (Modified Early Warning Score) using receiver operating characteristic curves, precision-recall curves, and other metrics. Results: The XGBoost model had the highest mean accuracy (0.919; area under the curve=0.77), outperforming the other two models as well as the Modified Early Warning Score. Important predictor variables included the type of oxygen delivery used in the emergency department, patient age, Emergency Severity Index level, respiratory rate, serum lactate, and demographic characteristics. Conclusions: The XGBoost model had high predictive accuracy, outperforming other early warning scores. The clinical plausibility and predictive ability of XGBoost suggest that the model could be used to predict 48-hour respiratory failure in admitted patients with COVID-19.
- Open Access
- 10 December 2020
- Published by Elsevier in International Journal of Medical Informatics
- Vol. 147, 104349
Dissemination of child abuse clinical decision support: Moving beyond a single electronic health record
- 10 December 2020
- Published by Elsevier in International Journal of Medical Informatics
- Vol. 147, 104349
Open AccessDissemination of child abuse clinical decision support: Moving beyond a single electronic health record