External validation of the Johns Hopkins Fall Risk Assessment Tool in older Dutch hospitalized patients
- 23 November 2022
- journal article
- research article
- Published by Springer Nature in European Geriatric Medicine
- Vol. 14 (1) , 69-77
Abstract
Purpose Fall prevention is a safety goal in many hospitals. The performance of the Johns Hopkins Fall Risk Assessment Tool (JHFRAT) in older inpatients is largely unknown. We aimed to assess the JHFRAT performance in a large sample of Dutch older inpatients, including its trend over time. Methods We used an Electronic Health Records (EHR) dataset with hospitalized patients (≥ 70), admitted for ≥ 24 h between 2016 and 2021. Inpatient falls were extracted from structured and free-text data. We assessed the association between JHFRAT and falls using logistic regression. For test accuracy, we calculated sensitivity, specificity, positive predictive value (PPV), and negative predictive value (NPV). Discrimination was measured by the AUC. For calibration, we plotted the predicted fall probability with the actual probability of falls. For time-related effects, we calculated the AUC per 6 months (using data of patients admitted during the 6 months’ time interval) and plotted these different AUC values over time. Furthermore, we compared the model (JHFRAT and falls) with and without adjusting for seasonal influenza, COVID-19, spring, summer, fall or winter periods. Results Data included 17,263 admissions with at least 1 JHFRAT measurement, a median age of 76 and a percentage female of 47%. The in-hospital fall prevalence was 2.5%. JHFRAT [OR = 1.11 (1.03–1.20)] and its subcategories were significantly associated with falls. For medium/high risk of falls (JHFRAT > 5), sensitivity was 73%, specificity 51%, PPV 4% and NPV 99%. The overall AUC was 0.67, varying over time between 0.62 and 0.71 (for 6 months’ time intervals). Seasonal influenza did affect the association between JHFRAT and falls. COVID-19, spring, summer, fall or winter did not affect the association. Conclusions Our results show an association between JHFRAT and falls, a low discrimination by JHFRAT for older inpatients and over-prediction in the calibration. Improvements in the fall-risk assessment are warranted to improve efficiency.Keywords
Funding Information
- innovation funds of Amsterdam UMC, location AMC
This publication has 40 references indexed in Scilit:
- Validity and reliability of the modified John Hopkins Fall Risk Assessment Tool for elderly patients in home health careGeriatric Nursing, 2013
- Detecting inpatient falls by using natural language processing of electronic medical recordsBMC Health Services Research, 2012
- A Prospective Cohort Study of Geriatric Syndromes Among Older Medical Patients Admitted to Acute Care HospitalsJournal of the American Geriatrics Society, 2011
- A Comparative Study on the Validity of Fall Risk Assessment Scales in Korean HospitalsAsian Nursing Research, 2011
- Preventing Falls and Fall-Related Injuries in HospitalsClinics in Geriatric Medicine, 2010
- Falls risk-prediction tools for hospital inpatients. Time to put them to bed?Age and Ageing, 2008
- The Johns Hopkins Fall Risk Assessment ToolJournal of Nursing Care Quality, 2007
- A risk profile for identifying community-dwelling elderly with a high risk of recurrent falling: results of a 3-year prospective studyOsteoporosis International, 2006
- An Evidence-based Approach to Fall Risk Assessment, Prevention, and ManagementJournal of Nursing Care Quality, 2005
- Influenza-Associated Hospitalizations in the United StatesJAMA, 2004