Novel Approach to Inpatient Fall Risk Prediction and Its Cross-Site Validation Using Time-Variant Data
Open Access
- 19 February 2019
- journal article
- research article
- Published by JMIR Publications Inc. in Journal of Medical Internet Research
- Vol. 21 (2) , e11505
Abstract
Journal of Medical Internet Research - International Scientific Journal for Medical Research, Information and Communication on the Internet #Preprint #PeerReviewMe: Warning: This is a unreviewed preprint. Readers are warned that the document has not been peer-reviewed by expert/patient reviewers or an academic editor, may contain misleading claims, and is likely to undergo changes before final publication, if accepted, or may have been rejected/withdrawn. Readers with interest and expertise are encouraged to sign up as peer-reviewer, if the paper is within an open peer-review period. Please cite this preprint only for review purposes or for grant applications and CVs (if you are the author). Background: Electronic medical records (EMRs) contain a considerable amount of information about patients. Objective: We investigated whether the readily available longitudinal EMRs data including nursing records could be utilized to compute the risk of inpatient falls and its accuracy when compared to existing fall risk assessment tools. Methods: Two study cohorts from two tertiary hospitals with different EMR systems and located near Seoul, South Korea were used. The modeling cohort included 14,307 admissions (122,179 hospital-days) and the validation cohort comprised 21,172 admissions (175,592 hospital-days) from each of 6 nursing units. A probabilistic Bayesian network model was used, and patient data were divided into windows with a length of 24 hours. Data on existing fall risk assessment tools, nursing processes, Korean Patient Classification System groups, medications, and administration data were used as model parameters. Model evaluation metrics were averaged using 10-fold cross validation. Results: The initial model showed an error rate of 11.7% and a spherical payoff of 0.91 with a c-statistic of 0.96, which represent far superior performance compared to that for the existing fall risk assessment tool (c-statistic = 0.69). The cross-site validation revealed an error rate of 9.3% and a spherical payoff of 0.92 with a c-statistic of 0.87, compared to a c-statistic of 0.65 for the existing fall risk assessment tool. The calibration curves for the model displayed more reliable results than the risk assessment tools. Nursing intervention data showed potential contributions to reducing the variance in the fall rate as did the risk factors of individual patients. Conclusions: A risk prediction model that considers longitudinal EMR data including nursing interventions can improve the ability to identify individual patients at a high risk of falling.Keywords
All Related Versions
This publication has 23 references indexed in Scilit:
- Interventions for preventing falls in older people in care facilities and hospitalsCochrane Database of Systematic Reviews, 2012
- Interventions for preventing falls in older people living in the communityCochrane Database of Systematic Reviews, 2012
- All At-Risk Patients Are Not Created EqualJournal of Wound, Ostomy & Continence Nursing, 2012
- Metrics for evaluating performance and uncertainty of Bayesian network modelsEcological Modelling, 2012
- Evaluation of the Expressiveness of an ICNP-based Nursing Data Dictionary in a Computerized Nursing Record SystemJournal of the American Medical Informatics Association, 2006
- Falls in Hospitalized PatientsCIN: Computers, Informatics, Nursing, 2006
- Validation of the Hendrich II Fall Risk Model: A large concurrent case/control study of hospitalized patientsApplied Nursing Research, 2003
- Sequential model criticism in probabilistic expert systemsIEEE Transactions on Pattern Analysis and Machine Intelligence, 1993
- What price perfection? Calibration and discrimination of clinical prediction modelsJournal of Clinical Epidemiology, 1992
- Development of a Scale to Identify the Fall-Prone PatientCanadian Journal on Aging / La Revue canadienne du vieillissement, 1989