Inter-rater disagreement in manual scoring of intensive care unit sleep data
Authors:
Preprint
- 3 April 2024
- preprint
- Published by Springer Nature in Research Square
Abstract
Objective: Severe sleep disruption is common among intensive care unit (ICU) patients. However, the applicability of standard sleep scoring guidelines by the American Academy of Sleep Medicine (AASM) has been questioned, with most polysomnography (PSG) studies in critically ill patients reporting difficulties in setting up and processing and scoring the recordings. The present study explores human inter-rater agreement in sleep stage scoring following the AASM guidelines, within a heterogenous ICU patient cohort. Results: Two human experts independently scored a total of 51,454 epochs in 20 PSG recordings acquired at the ICU. Epoch-per-epoch comparison of scored stages revealed a Cohen’s κ coefficient of agreement of 0.36 for standard 5-stage scoring. Highest agreement occurred in Wake (κ = 0.46), while REM showed the lowest (κ = 0.12). Significant correlations were found between inter-rater agreement, and Simplified Acute Physiology Score (SAPS II, r=-0.506, p=0.038), and 12-month mortality (r=-0.524, p=0.031). Comparison with similar studies underscore challenges in applying AASM criteria to ICU patients. Despite accounting for artifacts, disparities persisted, emphasizing the need for a nuanced exploration of factors influencing scoring inconsistencies in critically ill patients.Keywords
All Related Versions
- Version 1, 2024-04-03, Research Square
- Published version: BMC Research Notes, 18 (1), 138.
This publication has 33 references indexed in Scilit:
- A new classification for sleep analysis in critically ill patientsSleep Medicine, 2012
- Sedation and Sleep Disturbances in the ICUAnesthesiology Clinics, 2011
- Factors that impact on sleep in intensive care patientsIntensive and Critical Care Nursing, 2009
- Sleep and delirium in ICU patients: a review of mechanisms and manifestationsIntensive Care Medicine, 2009
- Assessment of Sleep in Ventilator-Supported Critically Ill PatientsSLEEP, 2008
- Sleep deprivation and pain perceptionSleep Medicine Reviews, 2006
- Sleep in the Critically ill PatientSLEEP, 2006
- Delirium in the Intensive Care Unit: Occurrence and Clinical Course in Older PatientsJournal of the American Geriatrics Society, 2003
- Partial night sleep deprivation reduces natural killer and celhdar immune responses in humansThe FASEB Journal, 1996
- Cerebral states during sleep, as studied by human brain potentials.Journal of Experimental Psychology, 1937