Assessing Hospital Surgical Quality
Open Access
- 23 September 2025
- journal article
- Published by Wolters Kluwer Health in Annals of Surgery Open
- Vol. 6 (4) , e610
Abstract
Objective: Develop a new hospital surgery report card for use in performance improvement. Background: When evaluating quality, a surgical program is aided by benchmark comparisons with outcomes achieved at other hospitals. To be credible, benchmarking should be based on the same surgical procedures and patient risk, despite there being many types of patients and procedures. Methods: Using Medicare patients undergoing general, orthopedic, or vascular surgery, each patient in a hospital is closely matched to 10 control patients from typical hospitals and to 10 control patients from well-resourced hospitals throughout the United States. Patients were matched on 200 characteristics, including procedure, comorbidities, socio-demographics, and the presence of multimorbidity. Hospitals were graded based on the differences in outcomes between matched sets of patients. As an illustration, we examine the 20 highest volume hospitals in Pennsylvania and provide detailed report cards on 2 example hospitals. Results: The hospitals studied differed in quality and grades, with better outcomes than matched controls for Hospital A and significantly worse outcomes than controls for Hospital B, depending on the type of surgery and patient. For the 20 largest hospitals in Pennsylvania, 5 had significantly elevated mortality, and 2 had significantly lower mortality than matched controls. Conclusions: Surgical programs benefit from knowing how their outcomes compare with those of other hospitals, both their overall outcomes and their outcomes for subsets of patients, such as patients with or without multimorbidity. Detailed reports based on matching can help identify meaningful deficiencies and strengths in programs concerning specific surgeries and patient types.Keywords
This publication has 32 references indexed in Scilit:
- Using Cardinality Matching to Design Balanced and Representative Samples for Observational StudiesJAMA, 2022
- Comparison of accuracy of prediction of postoperative mortality and morbidity between a new, parsimonious risk calculator (SURPAS) and the ACS Surgical Risk CalculatorThe American Journal of Surgery, 2020
- Surgeon Variation in Complications With Minimally Invasive and Open ColectomyJAMA Surgery, 2017
- Comparison of the Value of Nursing Work Environments in Hospitals Across Different Levels of Patient RiskJAMA Surgery, 2016
- Development and Evaluation of the Universal ACS NSQIP Surgical Risk Calculator: A Decision Aid and Informed Consent Tool for Patients and SurgeonsJournal of the American College of Surgeons, 2013
- The Michigan Surgical Quality Collaborative: a legacy of Shukri KhuriThe American Journal of Surgery, 2009
- Surgical Mortality as an Indicator of Hospital QualityJAMA, 2004
- Constructing a Control Group Using Multivariate Matched Sampling Methods That Incorporate the Propensity ScoreThe American Statistician, 1985
- The Accuracy of Population ProjectionsJournal of the American Statistical Association, 1983
- Institutional Differences in Postoperative Death RatesJAMA, 1968