Improving Intensive Care Unit Nurses' Delirium Assessment Performance Through a Multimodal Educational Intervention
Open Access
- 8 September 2025
- journal article
- Published by Wiley in Nursing in Critical Care
- Vol. 30 (5) , e70168
Abstract
Background: Delirium is a prevalent and serious ICU complication, particularly in elderly or ventilated patients. Accurate assessment is crucial but often inconsistent. Intensive care unit (ICU) nurses' use of the Intensive Care Delirium Screening Checklist (ICDSC) may be limited without structured training. Aim: To evaluate the delirium assessment performance of ICU nurses using ICDSC and assess the effectiveness of a multimodal educational intervention for performance enhancement. Study Design: This pre‐ and post‐intervention study was conducted in three medical ICUs in Northern Taiwan. The delirium assessment performance of ICU nurses using ICDSC was evaluated, followed by a three‐month multimodal educational intervention aimed at improving assessment performance. Each nurse's ICDSC assessment was paired with an independent assessment by a trained expert nurse. To ensure representation that reflects the true performance level, accounting for variations in nurses' working shifts, weekday and weekend staff ratios and sampling fairness across the three MICU units, the pairings were made using a three‐step randomization process, managed by an independent third party. A 3‐month multimodal educational intervention, including didactic lectures, difficult scenario reviews and one‐to‐one bedside mentoring, was implemented afterward. Inter‐rater agreement before and after the intervention was assessed using Cohen's kappa and Gwet's AC1 statistics. Results: The baseline agreement between ICU nurses and the expert nurse was suboptimal (kappa = 0.63, 95% CI: 0.57–0.70). The multimodal educational intervention was well‐received by the units, particularly among new nurses. Following the intervention, kappa significantly improved to 0.74 (95% CI: 0.69–0.80). Notable improvements were observed in key items of ICDSC, including the assessment of altered level of consciousness, inattention, disorientation, psychomotor agitation or retardation, and sleep–wake cycle disturbances. However, agreement remained poor for certain patient populations, especially those aged over 85 years and those subjected to physical restraint. Conclusions: A structured, multimodal educational intervention significantly improved the delirium assessment performance of ICU nurses using the ICDSC. One‐to‐one coaching and scenario‐based learning were particularly effective in enhancing clinical assessment skills. However, additional strategies may be required to address persistent challenges in assessing very elderly patients and those subjected to physical restraint. Relevance to Clinical Practice: A structured, multimodal educational intervention can substantially enhance the performance of ICU nurses in delirium screening using the ICDSC. Tailored training strategies may help bridge the knowledge–practice gap, leading to more reliable clinical assessments in critical care settings.Keywords
Funding Information
- National Taiwan University Hospital (114‐SS0050)
This publication has 20 references indexed in Scilit:
- Outcome of delirium in critically ill patients: systematic review and meta-analysisBMJ, 2015
- A comparison of Cohen’s Kappa and Gwet’s AC1 when calculating inter-rater reliability coefficients: a study conducted with personality disorder samplesBMC Medical Research Methodology, 2013
- Impact of delirium on clinical outcome in critically ill patients: a meta-analysisGeneral Hospital Psychiatry, 2013
- Incidence, prevalence, risk factor and outcome of delirium in intensive care unit: a study from IndiaGeneral Hospital Psychiatry, 2012
- Impact of a Delirium Screening Tool and Multifaceted Education on Nurses’ Knowledge of Delirium and Ability to Evaluate It CorrectlyAmerican Journal of Critical Care, 2012
- Combined didactic and scenario-based education improves the ability of intensive care unit staff to recognize delirium at the bedsideCritical Care, 2008
- Large-scale implementation of sedation and delirium monitoring in the intensive care unit: A report from two medical centers*Critical Care Medicine, 2005
- Nurses' Recognition of Delirium and Its SymptomsArchives of internal medicine (1960), 2001
- Intensive Care Delirium Screening Checklist: evaluation of a new screening toolIntensive Care Medicine, 2001
- The Measurement of Observer Agreement for Categorical DataBiometrics, 1977