Nirav Shah
Nirav Shah has a total of 133 co-authors. Here are the top co-authors by number of shared publications:
- Matthew Michael Churpek
Department of Medicine, University of Wisconsin-Madison, Madison, WI
6 shared publications - Dana P. Edelson
Department of Medicine, University of Chicago, Chicago, IL, United States
5 shared publications - Kyle A. Carey
Department of Medicine, University of Chicago, Chicago, IL, United States
5 shared publications - Christopher J. Winslow
Department of Medicine, Endeavor Health, Evanston, IL
4 shared publications - Emily Gilbert
Department of Medicine, Loyola University Medical Center, Chicago, IL
4 shared publications - Majid Afshar
Department of Medicine, University of Wisconsin-Madison , Madison, WI 53726
4 shared publications
Latest Publications
- Open Access
- 5 October 2026
- Published by Cambridge University Press (CUP) in Antimicrobial Stewardship & Healthcare Epidemiology
- Vol. 6  (1) , e313
Mandatory infectious diseases consultation and consensus approach effective at lowering antibiotic duration in uncomplicated gram-negative bacteremia
This article examines the impact of Infectious Diseases (ID) practitioner consensus on gram-negative bacteremia (GNB) treatment duration. This study included 1024 adults with GNB. During the study, ID consultation for GNB was made mandatory followed by development of a GNB guideline. Antibiotic therapy was shorter after guideline development.
- 5 October 2026
- Published by Cambridge University Press (CUP) in Antimicrobial Stewardship & Healthcare Epidemiology
- Vol. 6  (1) , e313
Open AccessMandatory infectious diseases consultation and consensus approach effective at lowering antibiotic duration in uncomplicated gram-negative bacteremia
This article examines the impact of Infectious Diseases (ID) practitioner consensus on gram-negative bacteremia (GNB) treatment duration. This study included 1024 adults with GNB. During the study, ID consultation for GNB was made mandatory followed by development of a GNB guideline. Antibiotic therapy was shorter after guideline development.
- Open Access
- 9 September 2026
- Published by Oxford University Press (OUP) in JAMIA Open
- Vol. 9  (5) , ooag163
Automating chart review for identification of infected patients using natural language processing
Objective: Expert clinician chart review is the most accurate method to identify patients with infection but is laborious and costly. We aimed to develop and externally validate machine-learning models using structured and unstructured data to identify infection in hospitalized patients compared to chart review. Materials and Methods: Adult inpatient encounters at 2 health systems (2006-2016) were manually annotated for suspected infection on admission. Data from one site were used to develop gradient-boosted machine-learning models. Structured features included labs, vital signs, and nursing assessments. Unstructured clinical notes were converted to concept unique identifiers (CUIs) using the clinical Text Analysis and Knowledge Extraction System. Unimodal and multimodal models were tuned to maximize the area under the receiver operating curve (AUROC) in the derivation site through cross-validation. Model discrimination and calibration were assessed in the external validation site. Results: Of the 3014 included admissions, 677 (22.5%) were classified as having suspected infection on admission. A multimodal model combining n-gram TF-IDF and structured data demonstrated the best performance, significantly outperforming the structured data only model (AUROC 0.88 vs 0.82, P < .001, area under the precision-recall curve 0.71 vs 0.58, P < .001). The most important features came from unstructured data. Discussion and Conclusion: Our results highlight the value of unstructured text data for developing models that accurately replicate chart reviews in identifying patients with infection. By expediting the annotation of infection cases, our models can facilitate epidemiological research and the curation of datasets necessary for developing clinical decision support systems for early sepsis detection.
- 9 September 2026
- Published by Oxford University Press (OUP) in JAMIA Open
- Vol. 9  (5) , ooag163
Open AccessAutomating chart review for identification of infected patients using natural language processing
Objective: Expert clinician chart review is the most accurate method to identify patients with infection but is laborious and costly. We aimed to develop and externally validate machine-learning models using structured and unstructured data to identify infection in hospitalized patients compared to chart review. Materials and Methods: Adult inpatient encounters at 2 health systems (2006-2016) were manually annotated for suspected infection on admission. Data from one site were used to develop gradient-boosted machine-learning models. Structured features included labs, vital signs, and nursing assessments. Unstructured clinical notes were converted to concept unique identifiers (CUIs) using the clinical Text Analysis and Knowledge Extraction System. Unimodal and multimodal models were tuned to maximize the area under the receiver operating curve (AUROC) in the derivation site through cross-validation. Model discrimination and calibration were assessed in the external validation site. Results: Of the 3014 included admissions, 677 (22.5%) were classified as having suspected infection on admission. A multimodal model combining n-gram TF-IDF and structured data demonstrated the best performance, significantly outperforming the structured data only model (AUROC 0.88 vs 0.82, P < .001, area under the precision-recall curve 0.71 vs 0.58, P < .001). The most important features came from unstructured data. Discussion and Conclusion: Our results highlight the value of unstructured text data for developing models that accurately replicate chart reviews in identifying patients with infection. By expediting the annotation of infection cases, our models can facilitate epidemiological research and the curation of datasets necessary for developing clinical decision support systems for early sepsis detection.
- Open Access
- 16 January 2026
- Published by JMIR Publications Inc. in JMIR AI
- Vol. 5, e81642
Treatment Recommendations for Clinical Deterioration on the Wards: Development and Validation of Machine Learning Models
Background: Clinical deterioration in general ward patients is associated with increased morbidity and mortality. Early and appropriate treatments can improve outcomes for such patients. While machine learning (ML) tools have proven successful in the early identification of clinical deterioration risk, little work has explored their effectiveness in providing data-driven treatment recommendations to clinicians for high-risk patients. Objective: This study established ML performance benchmarks for predicting the need for 10 common clinical deterioration interventions. This study also compared the performance of various ML models to inform which types of approaches are well-suited to these prediction tasks. Methods: We relied on a chart-reviewed, multicenter dataset of general ward patients experiencing clinical deterioration (n=2480 encounters), who were identified as high risk using a Food and Drug Administration–cleared early warning score (electronic Cardiac Arrest Risk Triage score). Manual chart review labeled each encounter with gold-standard lifesaving treatment labels. We trained elastic net logistic regression, gradient boosted machines, long short-term memory, and stacking ensemble models to predict the need for 10 common deterioration interventions at the time of the deterioration elevated risk score. Models were trained on encounters from 3 health systems and externally validated on encounters from a fourth health system. Discriminative performance, assessed by the area under the receiver operating characteristic curve (AUROC), was the primary evaluation metric. Results: Discriminative performance varied widely by model and prediction task, with AUROCs typically ranging from 0.7 to 0.9. Across all models, antiarrhythmics were the easiest treatment to predict (mean AUROC 0.866, SD 0.012) while anticoagulants were the hardest to predict (mean AUROC 0.660, SD 0.065). While no individual modeling approach outperformed the others across all tasks, the gradient boosted machines tended to show the best individual performance. Additionally, the stacking ensemble, which combined predictions from all models, typically matched or outperformed the best-performing individual model for each task. We also demonstrated that a sizable fraction of patients in our evaluation cohort were untreated at the time of the deterioration elevated risk score, highlighting an opportunity to leverage ML tools to decrease treatment latency. Conclusions: We found variability in the discrimination of ML models across tasks and model approaches for predicting lifesaving treatments in patients with clinical deterioration. Overall performance was high, and these models could be paired with early warning scores to provide clinicians with timely and actionable treatment recommendations to improve patient care.
- 16 January 2026
- Published by JMIR Publications Inc. in JMIR AI
- Vol. 5, e81642
Open AccessTreatment Recommendations for Clinical Deterioration on the Wards: Development and Validation of Machine Learning Models
Background: Clinical deterioration in general ward patients is associated with increased morbidity and mortality. Early and appropriate treatments can improve outcomes for such patients. While machine learning (ML) tools have proven successful in the early identification of clinical deterioration risk, little work has explored their effectiveness in providing data-driven treatment recommendations to clinicians for high-risk patients. Objective: This study established ML performance benchmarks for predicting the need for 10 common clinical deterioration interventions. This study also compared the performance of various ML models to inform which types of approaches are well-suited to these prediction tasks. Methods: We relied on a chart-reviewed, multicenter dataset of general ward patients experiencing clinical deterioration (n=2480 encounters), who were identified as high risk using a Food and Drug Administration–cleared early warning score (electronic Cardiac Arrest Risk Triage score). Manual chart review labeled each encounter with gold-standard lifesaving treatment labels. We trained elastic net logistic regression, gradient boosted machines, long short-term memory, and stacking ensemble models to predict the need for 10 common deterioration interventions at the time of the deterioration elevated risk score. Models were trained on encounters from 3 health systems and externally validated on encounters from a fourth health system. Discriminative performance, assessed by the area under the receiver operating characteristic curve (AUROC), was the primary evaluation metric. Results: Discriminative performance varied widely by model and prediction task, with AUROCs typically ranging from 0.7 to 0.9. Across all models, antiarrhythmics were the easiest treatment to predict (mean AUROC 0.866, SD 0.012) while anticoagulants were the hardest to predict (mean AUROC 0.660, SD 0.065). While no individual modeling approach outperformed the others across all tasks, the gradient boosted machines tended to show the best individual performance. Additionally, the stacking ensemble, which combined predictions from all models, typically matched or outperformed the best-performing individual model for each task. We also demonstrated that a sizable fraction of patients in our evaluation cohort were untreated at the time of the deterioration elevated risk score, highlighting an opportunity to leverage ML tools to decrease treatment latency. Conclusions: We found variability in the discrimination of ML models across tasks and model approaches for predicting lifesaving treatments in patients with clinical deterioration. Overall performance was high, and these models could be paired with early warning scores to provide clinicians with timely and actionable treatment recommendations to improve patient care.
- Open Access
- 26 March 2025
- Published by Wolters Kluwer Health in Critical Care Explorations
- Vol. 7  (4) , e1232
Multicenter Development and Prospective Validation of eCARTv5: A Gradient-Boosted Machine-Learning Early Warning Score
BACKGROUND: Early detection of clinical deterioration using machine-learning early warning scores may improve outcomes. However, most implemented scores were developed using logistic regression, only underwent retrospective validation, and were not tested in important subgroups. OBJECTIVE: The objective of our multicenter retrospective and prospective observational study was to develop and prospectively validate a gradient-boosted machine model (eCARTv5) for identifying clinical deterioration on the wards. DERIVATION COHORT: All adult patients admitted to the inpatient medical-surgical wards at seven hospitals in three health systems for model development (2006–2022). VALIDATION COHORT: All adult patients admitted to the inpatient medical-surgical wards and at 21 hospitals from three health systems for retrospective (2009–2023) and prospective (2023–2024) external validation. PREDICTION MODEL: Predictor variables (demographics, vital signs, documentation, and laboratory values) were used in a gradient-boosted trees algorithm to predict ICU transfer or death in the next 24 hours. The developed model (eCARTv5) was compared with the Modified Early Warning Score (MEWS), the National Early Warning Score (NEWS), and eCARTv2 using the area under the receiver operating characteristic curve (AUROC). RESULTS: The development cohort included 901,491 admissions, the retrospective validation cohort included 1,769,461 admissions, and the prospective validation cohort included 205,946 admissions. In retrospective validation, eCARTv5 had the highest AUROC (0.834; 95% CI, 0.834–0.835), followed by eCARTv2 (0.775 [95% CI, 0.775–0.776]), NEWS (0.766 [95% CI, 0.766–0.767]), and MEWS (0.704 [95% CI, 0.703–0.704]). eCARTv5’s performance remained high (AUROC ≥0.80) across a range of patient demographics, clinical conditions, and during prospective validation. CONCLUSION: We developed eCARTv5, which performed better than eCARTv2, NEWS, and MEWS retrospectively, prospectively, and across a range of subgroups. These results served as the foundation for Food and Drug Administration clearance for its use in identifying deterioration in hospitalized ward patients.
- 26 March 2025
- Published by Wolters Kluwer Health in Critical Care Explorations
- Vol. 7  (4) , e1232
Open AccessMulticenter Development and Prospective Validation of eCARTv5: A Gradient-Boosted Machine-Learning Early Warning Score
BACKGROUND: Early detection of clinical deterioration using machine-learning early warning scores may improve outcomes. However, most implemented scores were developed using logistic regression, only underwent retrospective validation, and were not tested in important subgroups. OBJECTIVE: The objective of our multicenter retrospective and prospective observational study was to develop and prospectively validate a gradient-boosted machine model (eCARTv5) for identifying clinical deterioration on the wards. DERIVATION COHORT: All adult patients admitted to the inpatient medical-surgical wards at seven hospitals in three health systems for model development (2006–2022). VALIDATION COHORT: All adult patients admitted to the inpatient medical-surgical wards and at 21 hospitals from three health systems for retrospective (2009–2023) and prospective (2023–2024) external validation. PREDICTION MODEL: Predictor variables (demographics, vital signs, documentation, and laboratory values) were used in a gradient-boosted trees algorithm to predict ICU transfer or death in the next 24 hours. The developed model (eCARTv5) was compared with the Modified Early Warning Score (MEWS), the National Early Warning Score (NEWS), and eCARTv2 using the area under the receiver operating characteristic curve (AUROC). RESULTS: The development cohort included 901,491 admissions, the retrospective validation cohort included 1,769,461 admissions, and the prospective validation cohort included 205,946 admissions. In retrospective validation, eCARTv5 had the highest AUROC (0.834; 95% CI, 0.834–0.835), followed by eCARTv2 (0.775 [95% CI, 0.775–0.776]), NEWS (0.766 [95% CI, 0.766–0.767]), and MEWS (0.704 [95% CI, 0.703–0.704]). eCARTv5’s performance remained high (AUROC ≥0.80) across a range of patient demographics, clinical conditions, and during prospective validation. CONCLUSION: We developed eCARTv5, which performed better than eCARTv2, NEWS, and MEWS retrospectively, prospectively, and across a range of subgroups. These results served as the foundation for Food and Drug Administration clearance for its use in identifying deterioration in hospitalized ward patients.
- Open Access
- 11 October 2024
- Published by Wolters Kluwer Health in Critical Care Explorations
- Vol. 6  (10) , e1165
Development and Validation of a Machine Learning Model for Early Detection of Untreated Infection
BACKGROUND: Early diagnostic uncertainty for infection causes delays in antibiotic administration in infected patients and unnecessary antibiotic administration in noninfected patients. OBJECTIVE: To develop a machine learning model for the early detection of untreated infection (eDENTIFI), with the presence of infection determined by clinician chart review. DERIVATION COHORT: Three thousand three hundred fifty-seven adult patients hospitalized between 2006 and 2018 at two health systems in Illinois, United States. VALIDATION COHORT: We validated in 1632 patients in a third Illinois health system using area under the receiver operating characteristic curve (AUC). PREDICTION MODEL: Using a longitudinal discrete-time format, we trained a gradient boosted machine model to predict untreated infection in the next 6 hours using routinely available patient demographics, vital signs, and laboratory results. RESULTS: eDENTIFI had an AUC of 0.80 (95% CI, 0.79–0.81) in the validation cohort and outperformed the systemic inflammatory response syndrome criteria with an AUC of 0.64 (95% CI, 0.64–0.65; p < 0.001). The most important features were body mass index, age, temperature, and heart rate. Using a threshold with a 47.6% sensitivity, eDENTIFI detected infection a median 2.0 hours (interquartile range, 0.9–5.2 hr) before antimicrobial administration, with a negative predictive value of 93.6%. Antibiotic administration guided by eDENTIFI could have decreased unnecessary IV antibiotic administration in noninfected patients by 10.8% absolute or 46.4% relative percentage points compared with clinicians. CONCLUSION: eDENTIFI could both decrease the time to antimicrobial administration in infected patients and unnecessary antibiotic administration in noninfected patients. Further prospective validation is needed.
- 11 October 2024
- Published by Wolters Kluwer Health in Critical Care Explorations
- Vol. 6  (10) , e1165
Open AccessDevelopment and Validation of a Machine Learning Model for Early Detection of Untreated Infection
BACKGROUND: Early diagnostic uncertainty for infection causes delays in antibiotic administration in infected patients and unnecessary antibiotic administration in noninfected patients. OBJECTIVE: To develop a machine learning model for the early detection of untreated infection (eDENTIFI), with the presence of infection determined by clinician chart review. DERIVATION COHORT: Three thousand three hundred fifty-seven adult patients hospitalized between 2006 and 2018 at two health systems in Illinois, United States. VALIDATION COHORT: We validated in 1632 patients in a third Illinois health system using area under the receiver operating characteristic curve (AUC). PREDICTION MODEL: Using a longitudinal discrete-time format, we trained a gradient boosted machine model to predict untreated infection in the next 6 hours using routinely available patient demographics, vital signs, and laboratory results. RESULTS: eDENTIFI had an AUC of 0.80 (95% CI, 0.79–0.81) in the validation cohort and outperformed the systemic inflammatory response syndrome criteria with an AUC of 0.64 (95% CI, 0.64–0.65; p < 0.001). The most important features were body mass index, age, temperature, and heart rate. Using a threshold with a 47.6% sensitivity, eDENTIFI detected infection a median 2.0 hours (interquartile range, 0.9–5.2 hr) before antimicrobial administration, with a negative predictive value of 93.6%. Antibiotic administration guided by eDENTIFI could have decreased unnecessary IV antibiotic administration in noninfected patients by 10.8% absolute or 46.4% relative percentage points compared with clinicians. CONCLUSION: eDENTIFI could both decrease the time to antimicrobial administration in infected patients and unnecessary antibiotic administration in noninfected patients. Further prospective validation is needed.
- Open Access
- 1 October 2024
- Published by Wolters Kluwer Health in Critical Care Explorations
- Vol. 6  (10) , e1161
Causes, Diagnostic Testing, and Treatments Related to Clinical Deterioration Events Among High-Risk Ward Patients
IMPORTANCE: Timely intervention for clinically deteriorating ward patients requires that care teams accurately diagnose and treat their underlying medical conditions. However, the most common diagnoses leading to deterioration and the relevant therapies provided are poorly characterized. OBJECTIVES: We aimed to determine the diagnoses responsible for clinical deterioration, the relevant diagnostic tests ordered, and the treatments administered among high-risk ward patients using manual chart review. DESIGN, SETTING, AND PARTICIPANTS: This was a multicenter retrospective observational study in inpatient medical-surgical wards at four health systems from 2006 to 2020. Randomly selected patients (1000 from each health system) with clinical deterioration, defined by reaching the 95th percentile of a validated early warning score, electronic Cardiac Arrest Risk Triage, were included. MAIN OUTCOMES AND MEASURES: Clinical deterioration was confirmed by a trained reviewer or marked as a false alarm if no deterioration occurred for each patient. For true deterioration events, the condition causing deterioration, relevant diagnostic tests ordered, and treatments provided were collected. RESULTS: Of the 4000 included patients, 2484 (62%) had clinical deterioration confirmed by chart review. Sepsis was the most common cause of deterioration (41%; n = 1021), followed by arrhythmia (19%; n = 473), while liver failure had the highest in-hospital mortality (41%). The most common diagnostic tests ordered were complete blood counts (47% of events), followed by chest radiographs (42%) and cultures (40%), while the most common medication orders were antimicrobials (46%), followed by fluid boluses (34%) and antiarrhythmics (19%). CONCLUSIONS AND RELEVANCE: We found that sepsis was the most common cause of deterioration, while liver failure had the highest mortality. Complete blood counts and chest radiographs were the most common diagnostic tests ordered, and antimicrobials and fluid boluses were the most common medication interventions. These results provide important insights for clinical decision-making at the bedside, training of rapid response teams, and the development of institutional treatment pathways for clinical deterioration.
- 1 October 2024
- Published by Wolters Kluwer Health in Critical Care Explorations
- Vol. 6  (10) , e1161
Open AccessCauses, Diagnostic Testing, and Treatments Related to Clinical Deterioration Events Among High-Risk Ward Patients
IMPORTANCE: Timely intervention for clinically deteriorating ward patients requires that care teams accurately diagnose and treat their underlying medical conditions. However, the most common diagnoses leading to deterioration and the relevant therapies provided are poorly characterized. OBJECTIVES: We aimed to determine the diagnoses responsible for clinical deterioration, the relevant diagnostic tests ordered, and the treatments administered among high-risk ward patients using manual chart review. DESIGN, SETTING, AND PARTICIPANTS: This was a multicenter retrospective observational study in inpatient medical-surgical wards at four health systems from 2006 to 2020. Randomly selected patients (1000 from each health system) with clinical deterioration, defined by reaching the 95th percentile of a validated early warning score, electronic Cardiac Arrest Risk Triage, were included. MAIN OUTCOMES AND MEASURES: Clinical deterioration was confirmed by a trained reviewer or marked as a false alarm if no deterioration occurred for each patient. For true deterioration events, the condition causing deterioration, relevant diagnostic tests ordered, and treatments provided were collected. RESULTS: Of the 4000 included patients, 2484 (62%) had clinical deterioration confirmed by chart review. Sepsis was the most common cause of deterioration (41%; n = 1021), followed by arrhythmia (19%; n = 473), while liver failure had the highest in-hospital mortality (41%). The most common diagnostic tests ordered were complete blood counts (47% of events), followed by chest radiographs (42%) and cultures (40%), while the most common medication orders were antimicrobials (46%), followed by fluid boluses (34%) and antiarrhythmics (19%). CONCLUSIONS AND RELEVANCE: We found that sepsis was the most common cause of deterioration, while liver failure had the highest mortality. Complete blood counts and chest radiographs were the most common diagnostic tests ordered, and antimicrobials and fluid boluses were the most common medication interventions. These results provide important insights for clinical decision-making at the bedside, training of rapid response teams, and the development of institutional treatment pathways for clinical deterioration.
- 19 July 2024
- Published by Wolters Kluwer Health in Critical Care Explorations
- Vol. 6  (7) , e1116
Development and Validation of a Machine Learning COVID-19 Veteran (COVet) Deterioration Risk Score
BACKGROUND AND OBJECTIVE: To develop the COVid Veteran (COVet) score for clinical deterioration in Veterans hospitalized with COVID-19 and further validate this model in both Veteran and non-Veteran samples. No such score has been derived and validated while incorporating a Veteran sample. DERIVATION COHORT: Adults (age ≥ 18 yr) hospitalized outside the ICU with a diagnosis of COVID-19 for model development to the Veterans Health Administration (VHA) (n = 80 hospitals). VALIDATION COHORT: External validation occurred in a VHA cohort of 34 hospitals, as well as six non-Veteran health systems for further external validation (n = 21 hospitals) between 2020 and 2023. PREDICTION MODEL: eXtreme Gradient Boosting machine learning methods were used, and performance was assessed using the area under the receiver operating characteristic curve and compared with the National Early Warning Score (NEWS). The primary outcome was transfer to the ICU or death within 24 hours of each new variable observation. Model predictor variables included demographics, vital signs, structured flowsheet data, and laboratory values. RESULTS: A total of 96,908 admissions occurred during the study period, of which 59,897 were in the Veteran sample and 37,011 were in the non-Veteran sample. During external validation in the Veteran sample, the model demonstrated excellent discrimination, with an area under the receiver operating characteristic curve of 0.88. This was significantly higher than NEWS (0.79; p < 0.01). In the non-Veteran sample, the model also demonstrated excellent discrimination (0.86 vs. 0.79 for NEWS; p < 0.01). The top three variables of importance were eosinophil percentage, mean oxygen saturation in the prior 24-hour period, and worst mental status in the prior 24-hour period. CONCLUSIONS: We used machine learning methods to develop and validate a highly accurate early warning score in both Veterans and non-Veterans hospitalized with COVID-19. The model could lead to earlier identification and therapy, which may improve outcomes.
- 19 July 2024
- Published by Wolters Kluwer Health in Critical Care Explorations
- Vol. 6  (7) , e1116
Development and Validation of a Machine Learning COVID-19 Veteran (COVet) Deterioration Risk Score
BACKGROUND AND OBJECTIVE: To develop the COVid Veteran (COVet) score for clinical deterioration in Veterans hospitalized with COVID-19 and further validate this model in both Veteran and non-Veteran samples. No such score has been derived and validated while incorporating a Veteran sample. DERIVATION COHORT: Adults (age ≥ 18 yr) hospitalized outside the ICU with a diagnosis of COVID-19 for model development to the Veterans Health Administration (VHA) (n = 80 hospitals). VALIDATION COHORT: External validation occurred in a VHA cohort of 34 hospitals, as well as six non-Veteran health systems for further external validation (n = 21 hospitals) between 2020 and 2023. PREDICTION MODEL: eXtreme Gradient Boosting machine learning methods were used, and performance was assessed using the area under the receiver operating characteristic curve and compared with the National Early Warning Score (NEWS). The primary outcome was transfer to the ICU or death within 24 hours of each new variable observation. Model predictor variables included demographics, vital signs, structured flowsheet data, and laboratory values. RESULTS: A total of 96,908 admissions occurred during the study period, of which 59,897 were in the Veteran sample and 37,011 were in the non-Veteran sample. During external validation in the Veteran sample, the model demonstrated excellent discrimination, with an area under the receiver operating characteristic curve of 0.88. This was significantly higher than NEWS (0.79; p < 0.01). In the non-Veteran sample, the model also demonstrated excellent discrimination (0.86 vs. 0.79 for NEWS; p < 0.01). The top three variables of importance were eosinophil percentage, mean oxygen saturation in the prior 24-hour period, and worst mental status in the prior 24-hour period. CONCLUSIONS: We used machine learning methods to develop and validate a highly accurate early warning score in both Veterans and non-Veterans hospitalized with COVID-19. The model could lead to earlier identification and therapy, which may improve outcomes.
- Open Access
- 8 April 2024
- Published by Oxford University Press (OUP) in JAMIA Open
- Vol. 7  (2) , ooae025
The Pandemic Response Commons
Objectives: A data commons is a software platform for managing, curating, analyzing, and sharing data with a community. The Pandemic Response Commons (PRC) is a data commons designed to provide a data platform for researchers studying an epidemic or pandemic.Methods: The PRC was developed using the open source Gen3 data platform and is based upon consortium, data, and platform agreements developed by the not-for-profit Open Commons Consortium. A formal consortium of Chicagoland area organizations was formed to develop and operate the PRC.Results: The consortium developed a general PRC and an instance of it for the Chicagoland region called the Chicagoland COVID-19 Commons. A Gen3 data platform was set up and operated with policies, procedures, and controls for a NIST SP 800-53 revision 4 Moderate system. A consensus data model for the commons was developed, and a variety of datasets were curated, harmonized and ingested, including statistical summary data about COVID cases, patient level clinical data, and SARS-CoV-2 viral variant data.Discussion and conclusions: Given the various legal and data agreements required to operate a data commons, a PRC is designed to be in place and operating at a low level prior to the occurrence of an epidemic, with the activities increasing as required during an epidemic. A regional instance of a PRC can also be part of a broader data ecosystem or data mesh consisting of multiple regional commons supporting pandemic response through sharing regional data.
- 8 April 2024
- Published by Oxford University Press (OUP) in JAMIA Open
- Vol. 7  (2) , ooae025
Open AccessThe Pandemic Response Commons
Objectives: A data commons is a software platform for managing, curating, analyzing, and sharing data with a community. The Pandemic Response Commons (PRC) is a data commons designed to provide a data platform for researchers studying an epidemic or pandemic.Methods: The PRC was developed using the open source Gen3 data platform and is based upon consortium, data, and platform agreements developed by the not-for-profit Open Commons Consortium. A formal consortium of Chicagoland area organizations was formed to develop and operate the PRC.Results: The consortium developed a general PRC and an instance of it for the Chicagoland region called the Chicagoland COVID-19 Commons. A Gen3 data platform was set up and operated with policies, procedures, and controls for a NIST SP 800-53 revision 4 Moderate system. A consensus data model for the commons was developed, and a variety of datasets were curated, harmonized and ingested, including statistical summary data about COVID cases, patient level clinical data, and SARS-CoV-2 viral variant data.Discussion and conclusions: Given the various legal and data agreements required to operate a data commons, a PRC is designed to be in place and operating at a low level prior to the occurrence of an epidemic, with the activities increasing as required during an epidemic. A regional instance of a PRC can also be part of a broader data ecosystem or data mesh consisting of multiple regional commons supporting pandemic response through sharing regional data.
- Open Access
- 18 March 2024
- Published by Cambridge University Press (CUP) in Antimicrobial Stewardship & Healthcare Epidemiology
- Vol. 4  (1) , e36
Adherence to stewardship recommendations for antibiotic discontinuation reduces antibiotic-associated adverse drug events
Inappropriate antibiotic use may lead to increased adverse drug events (ADEs). This study assessed whether an antimicrobial stewardship recommendation to discontinue antibiotics in patients with low likelihood for bacterial infection reduced antibiotic duration and antibiotic-associated ADEs. At a 4-hospital system, hospitalized adult patients receiving empiric antibiotics for suspected infection were identified between May 2, 2016 and June 30, 2018. For those patients who were deemed unlikely to have a bacterial infection, a note was left by an infectious diseases physician recommending antibiotic discontinuation. Patient cases were considered “adherent” to recommendations if antibiotics were discontinued within 48 hours of the note and “non-adherent” to recommendations if antibiotics were continued beyond this. Duration of antibiotics and potential antibiotic-associated ADEs were collected retrospectively. Attribution of the adverse event to the antibiotic was decided upon by the investigators. The incidence of ADEs and duration of antibiotics between the adherent and non-adherent groups were compared. Of 253 patients deemed unlikely to have a bacterial infection, 114 (45%) treatment teams stopped antibiotics within 48 hours of the recommendation, and 139 (55%) continued antibiotics. The total number of ADEs was significantly higher in the non-adherent group compared to the adherent group (34 ADEs vs 9 ADEs, P = .001). The median number of total prescribed antibiotic days was higher in the non-adherent group than in the adherent group (5 days vs 1 day, P < .001). This study demonstrates that stewardship programs may prevent ADEs by recommending antibiotic discontinuation in patients with low suspicion for bacterial infection.
- 18 March 2024
- Published by Cambridge University Press (CUP) in Antimicrobial Stewardship & Healthcare Epidemiology
- Vol. 4  (1) , e36
Open AccessAdherence to stewardship recommendations for antibiotic discontinuation reduces antibiotic-associated adverse drug events
Inappropriate antibiotic use may lead to increased adverse drug events (ADEs). This study assessed whether an antimicrobial stewardship recommendation to discontinue antibiotics in patients with low likelihood for bacterial infection reduced antibiotic duration and antibiotic-associated ADEs. At a 4-hospital system, hospitalized adult patients receiving empiric antibiotics for suspected infection were identified between May 2, 2016 and June 30, 2018. For those patients who were deemed unlikely to have a bacterial infection, a note was left by an infectious diseases physician recommending antibiotic discontinuation. Patient cases were considered “adherent” to recommendations if antibiotics were discontinued within 48 hours of the note and “non-adherent” to recommendations if antibiotics were continued beyond this. Duration of antibiotics and potential antibiotic-associated ADEs were collected retrospectively. Attribution of the adverse event to the antibiotic was decided upon by the investigators. The incidence of ADEs and duration of antibiotics between the adherent and non-adherent groups were compared. Of 253 patients deemed unlikely to have a bacterial infection, 114 (45%) treatment teams stopped antibiotics within 48 hours of the recommendation, and 139 (55%) continued antibiotics. The total number of ADEs was significantly higher in the non-adherent group compared to the adherent group (34 ADEs vs 9 ADEs, P = .001). The median number of total prescribed antibiotic days was higher in the non-adherent group than in the adherent group (5 days vs 1 day, P < .001). This study demonstrates that stewardship programs may prevent ADEs by recommending antibiotic discontinuation in patients with low suspicion for bacterial infection.
- Open Access
- 25 August 2022
- Published by JMIR Publications Inc. in JMIR Research Protocols
- Vol. 11  (8) , e36741
Continuous Remote Patient Monitoring in Patients With Heart Failure (Cascade Study): Protocol for a Mixed Methods Feasibility Study
Background: Heart failure (HF) is a prevalent chronic disease and is associated with increases in mortality and morbidity. HF is a leading cause of hospitalizations and readmissions in the United States. A potentially promising area for preventing HF readmissions is continuous remote patient monitoring (CRPM). Objective: The primary aim of this study is to determine the feasibility and preliminary efficacy of a CRPM solution in patients with HF at NorthShore University HealthSystem. Methods: This study is a feasibility study and uses a wearable biosensor to continuously remotely monitor patients with HF for 30 days after discharge. Eligible patients admitted with an HF exacerbation at NorthShore University HealthSystem are being recruited, and the wearable biosensor is placed before discharge. The biosensor collects physiological ambulatory data, which are analyzed for signs of patient deterioration. Participants are also completing a daily survey through a dedicated study smartphone. If prespecified criteria from the physiological data and survey results are met, a notification is triggered, and a predetermined electronic health record–based pathway of telephonic management is completed. In phase 1, which has already been completed, 5 patients were enrolled and monitored for 30 days after discharge. The results of phase 1 were analyzed, and modifications to the program were made to optimize it. After analysis of the phase 1 results, 15 patients are being enrolled for phase 2, which is a calibration and testing period to enable further adjustments to be made. After phase 2, we will enroll 45 patients for phase 3. The combined results of phases 1, 2, and 3 will be analyzed to determine the feasibility of a CRPM program in patients with HF. Semistructured interviews are being conducted with key stakeholders, including patients, and these results will be analyzed using the affective adaptation of the technology acceptance model. Results: During phase 1, of the 5 patients, 2 (40%) were readmitted during the study period. The study completion rate for phase 1 was 80% (4/5), and the study attrition rate was 20% (1/5). There were 57 protocol deviations out of 150 patient days in phase 1 of the study. The results of phase 1 were analyzed, and the study protocol was adjusted to optimize it for phases 2 and 3. Phase 2 and phase 3 results will be available by the end of 2022. Conclusions: A CRPM program may offer a low-risk solution to improve care of patients with HF after hospital discharge and may help to decrease readmission of patients with HF to the hospital. This protocol may also lay the groundwork for the use of CRPM solutions in other groups of patients considered to be at high risk. International Registered Report Identifier (IRRID): DERR1-10.2196/36741
- 25 August 2022
- Published by JMIR Publications Inc. in JMIR Research Protocols
- Vol. 11  (8) , e36741
Open AccessContinuous Remote Patient Monitoring in Patients With Heart Failure (Cascade Study): Protocol for a Mixed Methods Feasibility Study
Background: Heart failure (HF) is a prevalent chronic disease and is associated with increases in mortality and morbidity. HF is a leading cause of hospitalizations and readmissions in the United States. A potentially promising area for preventing HF readmissions is continuous remote patient monitoring (CRPM). Objective: The primary aim of this study is to determine the feasibility and preliminary efficacy of a CRPM solution in patients with HF at NorthShore University HealthSystem. Methods: This study is a feasibility study and uses a wearable biosensor to continuously remotely monitor patients with HF for 30 days after discharge. Eligible patients admitted with an HF exacerbation at NorthShore University HealthSystem are being recruited, and the wearable biosensor is placed before discharge. The biosensor collects physiological ambulatory data, which are analyzed for signs of patient deterioration. Participants are also completing a daily survey through a dedicated study smartphone. If prespecified criteria from the physiological data and survey results are met, a notification is triggered, and a predetermined electronic health record–based pathway of telephonic management is completed. In phase 1, which has already been completed, 5 patients were enrolled and monitored for 30 days after discharge. The results of phase 1 were analyzed, and modifications to the program were made to optimize it. After analysis of the phase 1 results, 15 patients are being enrolled for phase 2, which is a calibration and testing period to enable further adjustments to be made. After phase 2, we will enroll 45 patients for phase 3. The combined results of phases 1, 2, and 3 will be analyzed to determine the feasibility of a CRPM program in patients with HF. Semistructured interviews are being conducted with key stakeholders, including patients, and these results will be analyzed using the affective adaptation of the technology acceptance model. Results: During phase 1, of the 5 patients, 2 (40%) were readmitted during the study period. The study completion rate for phase 1 was 80% (4/5), and the study attrition rate was 20% (1/5). There were 57 protocol deviations out of 150 patient days in phase 1 of the study. The results of phase 1 were analyzed, and the study protocol was adjusted to optimize it for phases 2 and 3. Phase 2 and phase 3 results will be available by the end of 2022. Conclusions: A CRPM program may offer a low-risk solution to improve care of patients with HF after hospital discharge and may help to decrease readmission of patients with HF to the hospital. This protocol may also lay the groundwork for the use of CRPM solutions in other groups of patients considered to be at high risk. International Registered Report Identifier (IRRID): DERR1-10.2196/36741