The Win Ratio Method in Heart Failure Trials: Lessons Learnt from EMPULSE
Authors:
- Stuart J. PocockSPStuart J. Pocock
- João Pedro FerreiraJFJoão Pedro Ferreira
- Timothy J. CollierTCTimothy J. Collier
- Christiane E. AngermannCAChristiane E. Angermann
- Jan BiegusJBJan Biegus
- Sean P. CollinsSCSean P. Collins
- Mikhail KosiborodMKMikhail Kosiborod
- Michael E. NassifMNMichael E. Nassif
- Piotr PonikowskiPPPiotr Ponikowski
- Mitchell A. PsotkaMPMitchell A. Psotka
- John R. TeerlinkJTJohn R. Teerlink
- Jasper TrompJTJasper Tromp
Open Access
- 23 April 2023
- journal article
- research article
- Published by Oxford University Press (OUP) in European Journal of Heart Failure
- Vol. 25 (5) , 632-641
Abstract
Aims: The EMPULSE trial evaluated the clinical benefit of empagliflozin versus placebo using the stratified win ratio approach in 530 patients with acute heart failure (HF) after initial stabilization. We aim to elucidate how this method works and what it means, thereby giving guidance for use of the win ratio in future trials. Methods and results: The primary trial outcome is a hierarchical composite of death, number of HF events, time to first HF event, or a ≥5-point difference in Kansas City Cardiomyopathy Questionnaire (KCCQ) total symptom score change at 90 days. In an overall (unstratified) analysis we show how comparison of all 265 x 265 patients pairs contribute to ‘wins’ for empagliflozin and placebo at all four levels of the hierarchy, leading to an unstratified win ratio of 1.38 (95% confidence interval [CI] 1.11–1.71; p = 0.0036). How such a win ratio should (and should not) be interpreted is then described. The more complex primary analysis using a stratified win ratio is then presented in detail leading to a very similar overall result. Win ratios for de novo acute HF and decompensated chronic HF patients were 1.29 and 1.39, respectively, their weighted combination yielding an overall stratified win ratio of 1.36 (95% CI 1.09–1.68) (p = 0.0054). Alternative ways of including HF events and KCCQ scores in the clinical hierarchy are presented, leading to recommendations for their use in future trials. Specifically, inclusion of both number of HF events and time-to-first HF event appears an unnecessary complication. Also, the use of a 5-point margin for KCCQ score paired comparisons is not statistically necessary. Conclusions: The EMPULSE trial findings illustrate how deaths, clinical events and patient-reported outcomes can be integrated into a win ratio analysis strategy that yields clinically meaningful findings of patient benefit. This has implications for future trial designs that recognize the clinical priorities of patient evaluation and the need for efficient progress towards approval of new treatments.Keywords
This publication has 19 references indexed in Scilit:
- Comparison of Time-to-First Event and Recurrent-Event Methods in Randomized Clinical TrialsCirculation, 2018
- The stratified win ratioJournal of Biopharmaceutical Statistics, 2017
- Regression to the Mean in SYMPLICITY HTN-3JACC, 2016
- A generalized analytic solution to the win ratio to analyze a composite endpoint considering the clinical importance order among componentsPharmaceutical Statistics, 2016
- A win ratio approach to comparing continuous non‐normal outcomes in clinical trialsPharmaceutical Statistics, 2016
- Evaluating Treatment Efficacy by Multiple End Points in Phase II Acute Heart Failure Clinical TrialsCirculation: Heart Failure, 2012
- The win ratio: a new approach to the analysis of composite endpoints in clinical trials based on clinical prioritiesEuropean Heart Journal, 2011
- Generalized pairwise comparisons of prioritized outcomes in the two‐sample problemStatistics in Medicine, 2010
- Transcatheter Aortic-Valve Implantation for Aortic Stenosis in Patients Who Cannot Undergo SurgeryNew England Journal of Medicine, 2010
- Combining mortality and longitudinal measures in clinical trialsStatistics in Medicine, 1999