Estimating hazard ratios from published Kaplan‐Meier survival curves: A methods validation study
- 27 May 2019
- journal article
- research article
- Published by Wiley in Research Synthesis Methods
- Vol. 10 (3) , 465-475
Abstract
Objective: Various statistical methods have been developed to estimate hazard ratios (HRs) from published Kaplan‐Meier (KM) curves for the purpose of performing meta‐analyses. The objective of this study was to determine the reliability, accuracy, and precision of four commonly used methods by Guyot, Williamson, Parmar, and Hoyle and Henley.Design: Pivotal randomized controlled trials (RCTs) in oncology were identified from the pan‐Canadian Oncology Drug Review (pCODR) database (primary analysis) and the Food and Drug Administration's (FDA) drug approvals page (secondary analysis) between January 2012 and May 2016. Two reviewers independently reconstructed HRs using each method on KM curves extracted from each trial and compared them with reported HRs (gold standard). Bland‐Altman plots and summary statistics were calculated to assess accuracy and precision of these methods. Interrater reliability was assessed using intraclass correlation coefficient (ICC). These four methods were also applied to KM curves of different structures (ie, flat versus steep curves).Results: A total of 118 KM curves (55 RCTs) and 77 KM curves (46 RCTs) were extracted from pCODR and FDA, respectively. In the primary analysis, the Guyot method was the most accurate with the lowest mean error (0.0094; 95% CI, −0.0012‐0.020). All four methods had excellent interrater reliability. The Guyot method showed the smallest bias and greatest precision on the Bland‐Altman plots. The Guyot method was consistently superior in both the secondary and all sensitivity analyses.Conclusion: In the absence of reported HRs, we recommend that researchers consider the Guyot method to reconstruct HRs from KM curves when performing aggregate data meta‐analyses.Keywords
This publication has 20 references indexed in Scilit:
- Statistical Methods Used to Test for Agreement of Medical Instruments Measuring Continuous Variables in Method Comparison Studies: A Systematic ReviewPLOS ONE, 2012
- Enhanced secondary analysis of survival data: reconstructing the data from published Kaplan-Meier survival curvesBMC Medical Research Methodology, 2012
- Improved curve fits to summary survival data: application to economic evaluation of health technologiesBMC Medical Research Methodology, 2011
- Bench-to-bedside review: The importance of the precision of the reference technique in method comparison studies – with specific reference to the measurement of cardiac outputCritical Care, 2009
- A Note on Estimating Treatment Effect for Time-to-event Data in a Literature-based Meta-analysisMethods of Information in Medicine, 2009
- Practical methods for incorporating summary time-to-event data into meta-analysisTrials, 2007
- Meta-analysis of published studies or meta-analysis of individual data? Caesarean section in HIV-positive women as a study casePublic Health, 2003
- Aggregate data meta‐analysis with time‐to‐event outcomesStatistics in Medicine, 2002
- Proportional hazards tests and diagnostics based on weighted residualsBiometrika, 1994
- STATISTICAL METHODS FOR ASSESSING AGREEMENT BETWEEN TWO METHODS OF CLINICAL MEASUREMENTThe Lancet, 1986