Development and validation of interpretable machine learning models for inpatient fall events and electronic medical record integration
Authors:
Open Access
- 21 September 2022
- journal article
- research article
- Published by The Korean Society of Emergency Medicine in Clinical and Experimental Emergency Medicine
- Vol. 9 (4) , 345-353
Abstract
Objective Falls are one of the most frequently occurring adverse events among hospitalized patients. The Morse Fall Scale, which has been widely used for fall risk assessment, has the two limitations of low specificity and difficulty in practical implementation. The aim of this study was to develop and validate an interpretable machine learning model for prediction of falls to be integrated in an electronic medical record (EMR) system.Methods This was a retrospective study involving a tertiary teaching hospital in Seoul, Korea. Based on the literature, 83 known predictors were grouped into seven categories. Interpretable fall event prediction models were developed using multiple machine learning models including gradient boosting and Shapley values.Results Overall, 191,778 cases with 272 fall events (0.1%) were included in the analysis. With the validation cohort of 2020, the area under the receiver operating curve (AUROC) of the gradient boosting model was 0.817 (95% confidence interval [CI], 0.720–0.904), better performance than random forest (AUROC, 0.801; 95% CI, 0.708–0.890), logistic regression (AUROC, 0.802; 95% CI, 0.721–0.878), artificial neural net (AUROC, 0.736; 95% CI, 0.650–0.821), and conventional Morse fall score (AUROC, 0.652; 95% CI, 0.570–0.715). The model’s interpretability was enhanced at both the population and patient levels. The algorithm was later integrated into the current EMR system.Conclusion We developed an interpretable machine learning prediction model for inpatient fall events using EMR integration formats.Keywords
This publication has 19 references indexed in Scilit:
- Improving Prediction of Fall Risk Using Electronic Health Record Data With Various Types and Sources at Multiple TimesCIN: Computers, Informatics, Nursing, 2019
- Preventing Falls in Hospitalized PatientsClinics in Geriatric Medicine, 2019
- Novel Approach to Inpatient Fall Risk Prediction and Its Cross-Site Validation Using Time-Variant DataJournal of Medical Internet Research, 2019
- Incidence and characteristics of accidental falls in hospitalizations.2017
- Validation of Fall Risk Assessment Scales among Hospitalized Patients in South Korea using Retrospective Data AnalysisKorean Journal of Adult Nursing, 2015
- Transparent reporting of a multivariable prediction model for individual prognosis or diagnosis (TRIPOD): the TRIPOD statementBMJ, 2014
- Instruments for assessing the risk of falls in acute hospitalized patients: a systematic review and meta-analysisBMC Health Services Research, 2013
- Falls Among Adult Patients Hospitalized in the United States: Prevalence and TrendsJournal of Patient Safety, 2013
- Comparison of the Reliability and Validity of Fall Risk Assessment Tools in Patients with Acute Neurological DisordersKorean Journal of Adult Nursing, 2013
- Computerized evaluation of a scale to identify the fall-prone patient.1986