Inter-Rater Agreement of the Classification of Intraoperative Adverse Events (ClassIntra) in Abdominal Surgery
Authors:
- 18 June 2021
- journal article
- research article
- Published by Wolters Kluwer Health in Annals of Surgery
- Vol. 277 (2) , e273-e279
Abstract
Objective and Summary of Background Data: Adverse events in surgical patients can occur preoperatively, intraoperatively, and postoperatively. Universally accepted classification systems are not yet available for intraoperative adverse events (iAEs). ClassIntra has recently been developed and validated as a tool for grading iAEs that occur between skin incision and skin closure irrespective of the origin, that is, surgery, anesthesia, or organizational. The aim of this study is to assess the inter-rater agreement of ClassIntra and assess its predictive value for postoperative complications in elective abdominal surgery. Methods: This study is a secondary use of data from the LAParotomy or LAParoscopy and ADhesiolysis (LAPAD) study, with detailed data on incidence and management of intra-operative and post-operative complications. Data were collected in a cohort of elective abdominal surgeries. Two teams graded all recorded events in the LAPAD study according to ClassIntra. Cohen Kappa coefficient was calculated to determine inter-rater agreement. Uni- and multivariable linear regression was used to assess the predictive value of the ClassIntra grades for postoperative complications. Results: IAEs were rated in 333 of 755 (44%) surgeries by team 1, and in 324 of 755 (43%) surgeries by team 2. Cohen kappa coefficient for ClassIntra grades was 0.87 [95% confidence interval (CI) 0.84–0.90]. Discrepancies in grading were most frequent for intraoperative bleeding and adhesions' associated injuries. At least 1 postoperative complication was observed in 278 (37%) patients. The risk of a postoperative complications increased with every increase in severity grade of ClassIntra. Intraoperative hypotension [mean difference (MD) 23.41, 95% CI 12.93–33.90] and other organ injuries (MD 18.90, 95% CI –4.22 – 42.02) were the strongest predictors for postoperative complications. Conclusions: ClassIntra has an almost perfect inter-rater agreement for the classification of iAEs. An increasing grade of ClassIntra was associated with a higher incidence of postoperative complications. Discrepancies in grading related to common complications in abdominal procedures mostly consisted of intraoperative bleeding and adhesion-related injuries. Grading of interoperative events in abdominal surgery might further improve by consensus regarding the definitions of a number of frequent events.Keywords
This publication has 38 references indexed in Scilit:
- Comparison of operative notes with real-time observation of adhesiolysis-related complications during surgeryBritish Journal of Surgery, 2013
- The Impact of Complications on Costs of Major Surgical ProceduresAnnals of Surgery, 2011
- Impact of intraoperative hypotension on hospital stay in major abdominal surgeryJournal of Anesthesia, 2011
- Predicting the Risk of Anastomotic Leakage in Left-sided Colorectal Surgery Using a Colon Leakage ScoreJournal of Surgical Research, 2011
- A Surgical Safety Checklist to Reduce Morbidity and Mortality in a Global PopulationNew England Journal of Medicine, 2009
- Assessment of Complications After Pancreatic SurgeryAnnals of Surgery, 2006
- Classification of Surgical ComplicationsAnnals of Surgery, 2004
- Risk factors for anastomotic leakage after resection of rectal cancerBritish Journal of Surgery, 1998
- Weighted kappa: Nominal scale agreement provision for scaled disagreement or partial credit.Psychological Bulletin, 1968
- A Coefficient of Agreement for Nominal ScalesEducational and Psychological Measurement, 1960