Early Warning Scores to Support Continuous Wireless Vital Sign Monitoring for Complication Prediction in Patients on Surgical Wards: Retrospective Observational Study (Preprint)
Authors:
- Mathilde C van RossumMRMathilde C van Rossum
- Robin E M BekhuisRBRobin E M Bekhuis
- Ying WangYWYing Wang
- Johannes H HegemanJHJohannes H Hegeman
- Ellis C FolbertEFEllis C Folbert
- Miriam M R Vollenbroek-HuttenMVMiriam M R Vollenbroek-Hutten
- Cornelis J KalkmanCKCornelis J Kalkman
- Ewout A KouwenhovenEKEwout A Kouwenhoven
- Hermie J HermensHHHermie J Hermens
Preprint
- 24 November 2022
- preprint
- Published by JMIR Publications Inc. in JMIR Preprints
Abstract
BACKGROUND Wireless vital sign sensors are increasingly being used to monitor patients on surgical wards. Although early warning scores (EWSs) are the current standard for the identification of patient deterioration in a ward setting, their usefulness for continuous monitoring is unknown. OBJECTIVE This study aimed to explore the usability and predictive value of high-rate EWSs obtained from continuous vital sign recordings for early identification of postoperative complications and compares the performance of a sensor-based EWS alarm system with manual intermittent EWS measurements and threshold alarms applied to individual vital sign recordings (single-parameter alarms). METHODS Continuous vital sign measurements (heart rate, respiratory rate, blood oxygen saturation, and axillary temperature) collected with wireless sensors in patients on surgical wards were used for retrospective simulation of EWSs (sensor EWSs) for different time windows (1-240 min), adopting criteria similar to EWSs based on manual vital signs measurements (nurse EWSs). Hourly sensor EWS measurements were compared between patients with (event group: 14/46, 30%) and without (control group: 32/46, 70%) postoperative complications. In addition, alarms were simulated for the sensor EWSs using a range of alarm thresholds (1-9) and compared with alarms based on nurse EWSs and single-parameter alarms. Alarm performance was evaluated using the sensitivity to predict complications within 24 hours, daily alarm rate, and false discovery rate (FDR). RESULTS The hourly sensor EWSs of the event group (median 3.4, IQR 3.1-4.1) was significantly higher (P<.004) compared with the control group (median 2.8, IQR 2.4-3.2). The alarm sensitivity of the hourly sensor EWSs was the highest (80%-67%) for thresholds of 3 to 5, which was associated with alarm rates of 2 (FDR=85%) to 1.2 (FDR=83%) alarms per patient per day respectively. The sensitivity of sensor EWS–based alarms was higher than that of nurse EWS–based alarms (maximum=40%) but lower than that of single-parameter alarms (87%) for all thresholds. In contrast, the (false) alarm rates of sensor EWS–based alarms were higher than that of nurse EWS–based alarms (maximum=0.6 alarm/patient/d; FDR=80%) but lower than that of single-parameter alarms (2 alarms/patient/d; FDR=84%) for most thresholds. Alarm rates for sensor EWSs increased for shorter time windows, reaching 70 alarms per patient per day when calculated every minute. CONCLUSIONS EWSs obtained using wireless vital sign sensors may contribute to the early recognition of postoperative complications in a ward setting, with higher alarm sensitivity compared with manual EWS measurements. Although hourly sensor EWSs provide fewer alarms compared with single-parameter alarms, high false alarm rates can be expected when calculated over shorter time spans. Further studies are recommended to optimize care escalation criteria for continuous monitoring of vital signs in a ward setting and to evaluate the effects on patient outcomes.Keywords
All Related Versions
- Published version: JMIR Perioperative Medicine, 6 (1), e44483.
This publication has 38 references indexed in Scilit:
- Nurses’ ‘worry’ as predictor of deteriorating surgical ward patients: A prospective cohort study of the Dutch-Early-Nurse-Worry-Indicator-ScoreInternational Journal of Nursing Studies, 2016
- Investigating the “Rule of W,” a Mnemonic for Teaching on Postoperative ComplicationsJournal of Surgical Education, 2015
- Postoperative complications and implications on patient-centered outcomesJournal of Surgical Research, 2013
- The role of patients and their relatives in ‘speaking up’ about their own safety – a qualitative study of acute illnessHealth Expectations, 2013
- “Identifying the hospitalised patient in crisis”—A consensus conference on the afferent limb of Rapid Response SystemsResuscitation, 2010
- Nurses’ role in detecting deterioration in ward patients: systematic literature reviewJournal of Advanced Nursing, 2009
- Agreement Between Methods of Measurement with Multiple Observations Per IndividualJournal of Biopharmaceutical Statistics, 2007
- A comparison of Antecedents to Cardiac Arrests, Deaths and EMergency Intensive care Admissions in Australia and New Zealand, and the United Kingdom—the ACADEMIA studyResuscitation, 2004
- Classification of Surgical ComplicationsAnnals of Surgery, 2004
- Temporal Patterns of Postoperative ComplicationsArchives of Surgery, 2003