Inter-rater and intrarater reliability of the South African Triage Scale in low-resource settings of Haiti and Afghanistan
Open Access
- 16 March 2018
- journal article
- research article
- Published by BMJ in Emergency Medicine Journal
- Vol. 35 (6) , 379-383
Abstract
Objective The South African Triage Scale (SATS) has demonstrated good validity in the EDs of Médecins Sans Frontières (MSF)-supported sites in Afghanistan and Haiti; however, corresponding reliability in these settings has not yet been reported on. This study set out to assess the inter-rater and intrarater reliability of the SATS in four MSF-supported EDs in Afghanistan and Haiti (two trauma-only EDs and two mixed (including both medical and trauma cases) EDs). Methods Under classroom conditions between December 2013 and February 2014, ED nurses at each site assigned triage ratings to a set of context-specific vignettes (written case reports of ED patients). Inter-rater reliability was assessed by comparing triage ratings among nurses; intrarater reliability was assessed by asking the nurses to retriage 10 random vignettes from the original set and comparing these duplicate ratings. Inter-rater reliability was calculated using the unweighted kappa, linearly weighted kappa and quadratically weighted kappa (QWK) statistics, and the intraclass correlation coefficient (ICC). Intrarater reliability was calculated according to the percentage of exact agreement and the percentage of agreement allowing for one level of discrepancy in triage ratings. The correlation between years of nursing experience and reliability of the SATS was assessed based on comparison of ICCs and the respective 95% CIs. Results A total of 67 nurses agreed to participate in the study: In Afghanistan there were 19 nurses from Kunduz Trauma Centre and nine from Ahmed Shah Baba; in Haiti, there were 20 nurses from Martissant Emergency Centre and 19 from Tabarre Surgical and Trauma Centre. Inter-rater agreement was moderate across all sites (ICC range: 0.50–0.60; QWK range: 0.50–0.59) apart from the trauma ED in Haiti where it was moderate to substantial (ICC: 0.58; QWK: 0.61). Intrarater agreement was similar across the four sites (68%–74% exact agreement); when allowing for a one-level discrepancy in triage ratings, intrarater reliability was near perfect across all sites (96%–99%). No significant correlation was found between years of nursing experience and reliability. Conclusion The SATS has moderate reliability in different EDs in Afghanistan and Haiti. These findings, together with concurrent findings showing that the SATS has good validity in the same settings, provide evidence to suggest that SATS is suitable in trauma-only and mixed EDs in low-resource settings.Keywords
Funding Information
- South African Medical Research Council
This publication has 23 references indexed in Scilit:
- Decreased Pediatric Hospital Mortality After an Intervention to Improve Emergency Care in Lilongwe, MalawiPediatrics, 2012
- The South African Triage Scale (adult version) provides reliable acuity ratingsInternational Emergency Nursing, 2012
- Emergency triage, assessment and treatment at a district hospital in MalawiEmergency Medicine Journal, 2011
- Inter-rater reliability of the South African Triage Scale: Assessing two different cadres of health care workers in a real time environmentAfrican Journal of Emergency Medicine, 2011
- The Princess Marina Hospital accident and emergency triage scale provides highly reliable triage acuity ratingsEmergency Medicine Journal, 2011
- Guidelines for Reporting Reliability and Agreement Studies (GRRAS) were proposedJournal of Clinical Epidemiology, 2011
- Reliability and validity of the Manchester Triage System in a general emergency department patient population in the Netherlands: results of a simulation studyEmergency Medicine Journal, 2008
- Triage Tool Inter-rater Reliability: A Comparison of Live Versus Paper Case ScenariosJournal of Emergency Nursing, 2007
- The cape triage score: a new triage system South Africa. Proposal from the cape triage groupEmergency Medicine Journal, 2006
- The Emergency Severity Index Triage Algorithm Version 2 Is Reliable and ValidAcademic Emergency Medicine, 2003