Comparison of cardiac surgery mortality reports using administrative and clinical data sources: a prospective cohort study
Authors:
- 4 September 2018
- journal article
- Published by CMA Impact Inc. in CMAJ Open
- Vol. 6 (3) , E316-E321
Abstract
Background: Outcomes for coronary artery bypass surgery are of broadening interest, but the impact of data type on quality reporting has not been fully examined. We compared the performance of administrative and clinical data–based risk adjustment models at a tertiary–quaternary care hospital. Methods: We used a prospective study design to test two risk adjustment models, one from administrative (Canadian Institute for Health Information [CIHI] Cardiac Care Quality Indicator) and one from clinical data (Society of Thoracic Surgeons), on cardiac surgical procedures performed between 2013 and 2016 (n = 1635). Our primary outcome was in-hospital mortality within 30 days of surgery. Model performance was established by comparing predicted and observed mortality, model calibration and handling of critical covariates. Results: Observed mortality was 1.96%, which was the same as that predicted by the Society of Thoracic Surgeons model (1.96%), but significantly higher than that predicted by the CIHI model (1.03%). Despite both models having similar C statistics (0.756 CIHI; 0.758 Society of Thoracic Surgeons), the CIHI model showed significant underestimation of mortality among patients at higher risk. There was significant miscalibration of risk associated with 7 covariates: New York Heart Association class IV, congestive heart failure, ejection fraction less than 20%, atrial fibrillation, acute coronary insufficiency, cardiac compromise (shock, myocardial infarction < 24 h, intra-aortic balloon pump, cardiac resuscitation or preprocedure circulatory support) and creatinine concentration of 100 mg/dL or more. Together, these factors accounted for 84% of the difference in predicted mortality between the administrative and clinical models. Interpretation: Risk prediction using administrative data underestimated risk of death, potentially inflating observed-to-predicted mortality ratios at hospitals with patients who are more ill. Caution is warranted when hospital reports of cardiac surgery outcomes are based on administrative data alone.Keywords
This publication has 21 references indexed in Scilit:
- Using Both Clinical Registry and Administrative Claims Data to Measure Risk-adjusted Surgical OutcomesAnnals of Surgery, 2016
- Risk‐Adjusted In‐Hospital Mortality Models for Congestive Heart Failure and Acute Myocardial Infarction: Value of Clinical Laboratory Data and Race/EthnicityHealth Services Research, 2015
- The Dutch Hospital Standardised Mortality Ratio (HSMR) method and cardiac surgery: benchmarking in a national cohort using hospital administration data versus a clinical databaseHeart, 2013
- Incremental Value of Clinical Data Beyond Claims Data in Predicting 30-Day Outcomes After Heart Failure HospitalizationCirculation: Cardiovascular Quality and Outcomes, 2011
- Estimating the number of coronary artery bypass graft and percutaneous coronary intervention procedures in Canada: A comparison of cardiac registry and Canadian Institute for Health Information data sourcesCanadian Journal of Cardiology, 2010
- Effectiveness of Public Report Cards for Improving the Quality of Cardiac CareJAMA, 2009
- The Society of Thoracic Surgeons 2008 Cardiac Surgery Risk Models: Part 3—Valve Plus Coronary Artery Bypass Grafting SurgeryThe Annals of Thoracic Surgery, 2009
- Comparison of Clinical and Administrative Data Sources for Hospital Coronary Artery Bypass Graft Surgery Report CardsCirculation, 2007
- Mortality After Noncardiac SurgeryMedical Care, 2005
- Risk adjustment for coronary artery bypass graft surgery: an administrative approach versus EuroSCOREInternational Journal for Quality in Health Care, 2004