Population Adjustment Methods for Indirect Comparisons: A Review of National Institute for Health and Care Excellence Technology Appraisals
Open Access
- 13 June 2019
- journal article
- review article
- Published by Cambridge University Press (CUP) in International Journal of Technology Assessment in Health Care
- Vol. 35 (03) , 221-228
Abstract
Objectives: Indirect comparisons via a common comparator (anchored comparisons) are commonly used in health technology assessment. However, common comparators may not be available, or the comparison may be biased due to differences in effect modifiers between the included studies. Recently proposed population adjustment methods aim to adjust for differences between study populations in the situation where individual patient data are available from at least one study, but not all studies. They can also be used when there is no common comparator or for single-arm studies (unanchored comparisons). We aim to characterise the use of population adjustment methods in technology appraisals (TAs) submitted to the United Kingdom National Institute for Health and Care Excellence (NICE).Methods: We reviewed NICE TAs published between 01/01/2010 and 20/04/2018.Results: Population adjustment methods were used in 7 percent (18/268) of TAs. Most applications used unanchored comparisons (89 percent, 16/18), and were in oncology (83 percent, 15/18). Methods used included matching-adjusted indirect comparisons (89 percent, 16/18) and simulated treatment comparisons (17 percent, 3/18). Covariates were included based on: availability, expert opinion, effective sample size, statistical significance, or cross-validation. Larger treatment networks were commonplace (56 percent, 10/18), but current methods cannot account for this. Appraisal committees received results of population-adjusted analyses with caution and typically looked for greater cost effectiveness to minimise decision risk.Conclusions: Population adjustment methods are becoming increasingly common in NICE TAs, although their impact on decisions has been limited to date. Further research is needed to improve upon current methods, and to investigate their properties in simulation studies.Keywords
This publication has 9 references indexed in Scilit:
- Network Meta‐Analysis for Decision Making2018
- Methods for Population-Adjusted Indirect Comparisons in Health Technology AppraisalMedical Decision Making, 2017
- Regulatory approval of pharmaceuticals without a randomised controlled study: analysis of EMA and FDA approvals 1999–2014BMJ Open, 2016
- Evidence Synthesis for Decision Making 2Medical Decision Making, 2012
- Comparative Effectiveness Without Head-to-Head TrialsPharmacoEconomics, 2010
- No Head-to-Head Trial? Simulate the Missing ArmsPharmacoEconomics, 2010
- Simultaneous comparison of multiple treatments: combining direct and indirect evidenceBMJ, 2005
- Stepwise Selection in Small Data Sets A Simulation Study of Bias in Logistic Regression AnalysisJournal of Clinical Epidemiology, 1999
- The results of direct and indirect treatment comparisons in meta-analysis of randomized controlled trialsJournal of Clinical Epidemiology, 1997