Evaluation of the American College of Surgeons National Surgical Quality Improvement Program Risk Calculator to predict outcomes after hysterectomies
Authors:
- 20 December 2021
- journal article
- research article
- Published by Wiley in International Journal of Gynecology & Obstetrics
- Vol. 158 (3) , 714-721
Abstract
Objective: To evaluate the American College of Surgeons (ACS) surgical risk calculator's reliability in predicting outcomes in hysterectomies.Methods: This is a prospective cohort study at a large community‐based hospital. Twenty‐one preoperative and postoperative criteria were abstracted from the electronic medical record and entered into the online ACS calculator to determine a risk score. Logistical regression was used to determine the association between risk score and actual outcome. The prediction capability was analyzed with c‐statistic, Hosmer‐Lemeshow, and Brier score.Results: A total of 634 hysterectomies were performed during the study period from January to April 2019. Patients were predominantly 55 years old, white (53%) and overweight (body mass index 30). Predicted perioperative adverse events were significantly higher than actual adverse events across all domains. In all, 54/634 (8.5%) patients experienced postoperative urinary tract infection. C‐statistics for return to operating room, renal failure, and readmission were 0.607 (95% C Statistic index [CI] 0.370–0.845), 0.882 (95% CI 0.802–0.962), 0.637 (95% CI 0.524–0.750), respectively. Brier scores approached one in all categorical domains.Conclusion: The ACS surgical risk calculator holds the promise of predicting postoperative complications or length of stay for patients undergoing hysterectomy. Further adjustment to this tool is required before it can be advocated for use in the clinical setting.Keywords
This publication has 23 references indexed in Scilit:
- Development and Evaluation of the Universal ACS NSQIP Surgical Risk Calculator: A Decision Aid and Informed Consent Tool for Patients and SurgeonsJournal of the American College of Surgeons, 2013
- Nationwide Trends in the Performance of Inpatient Hysterectomy in the United StatesObstetrics & Gynecology, 2013
- Optimizing ACS NSQIP Modeling for Evaluation of Surgical Quality and Risk: Patient Risk Adjustment, Procedure Mix Adjustment, Shrinkage Adjustment, and Surgical FocusJournal of the American College of Surgeons, 2013
- Relevance of the C-Statistic When Evaluating Risk-Adjustment Models in SurgeryJournal of the American College of Surgeons, 2012
- Assessing the Performance of Prediction ModelsEpidemiology, 2010
- New approaches to the National Surgical Quality Improvement Program: the American College of Surgeons experienceThe American Journal of Surgery, 2009
- Does Surgical Quality Improve in the American College of Surgeons National Surgical Quality Improvement ProgramAnnals of Surgery, 2009
- Development of an American College of Surgeons National Surgery Quality Improvement Program: Morbidity and Mortality Risk Calculator for Colorectal SurgeryJournal of the American College of Surgeons, 2009
- Hysterectomy Rates in the United States, 2003Obstetrics & Gynecology, 2007
- Assessing the calibration of mortality benchmarks in critical care: The Hosmer-Lemeshow test revisited*Critical Care Medicine, 2007