Understanding Treatment Effect Estimates When Treatment Effects Are Heterogeneous for More Than One Outcome
- 27 March 2018
- journal article
- research article
- Published by Springer Nature in Applied Health Economics and Health Policy
- Vol. 16 (3) , 381-393
Abstract
Background Patient-centred care requires evidence of treatment effects across many outcomes. Outcomes can be beneficial (e.g. increased survival or cure rates) or detrimental (e.g. adverse events, pain associated with treatment, treatment costs, time required for treatment). Treatment effects may also be heterogeneous across outcomes and across patients. Randomized controlled trials are usually insufficient to supply evidence across outcomes. Observational data analysis is an alternative, with the caveat that the treatments observed are choices. Real-world treatment choice often involves complex assessment of expected effects across the array of outcomes. Failure to account for this complexity when interpreting treatment effect estimates could lead to clinical and policy mistakes. Objective Our objective was to assess the properties of treatment effect estimates based on choice when treatments have heterogeneous effects on both beneficial and detrimental outcomes across patients. Methods Simulation methods were used to highlight the sensitivity of treatment effect estimates to the distributions of treatment effects across patients across outcomes. Scenarios with alternative correlations between benefit and detriment treatment effects across patients were used. Regression and instrumental variable estimators were applied to the simulated data for both outcomes. Results True treatment effect parameters are sensitive to the relationships of treatment effectiveness across outcomes in each study population. In each simulation scenario, treatment effect estimate interpretations for each outcome are aligned with results shown previously in single outcome models, but these estimates vary across simulated populations with the correlations of treatment effects across patients across outcomes. Conclusions If estimator assumptions are valid, estimates across outcomes can be used to assess the optimality of treatment rates in a study population. However, because true treatment effect parameters are sensitive to correlations of treatment effects across outcomes, decision makers should be cautious about generalizing estimates to other populations.Keywords
Funding Information
- Patient-Centered Outcomes Research Institute (ME-1303-6011)
This publication has 44 references indexed in Scilit:
- Risk‐Treatment Paradox in the Selection of Transradial Access for Percutaneous Coronary InterventionJournal of the American Heart Association, 2013
- Building useful evidence: changing the clinical research paradigm to account for comparative effectiveness researchJournal of Comparative Effectiveness Research, 2012
- Some Cautions on the Use of Instrumental Variables Estimators in Outcomes Research: How Bias in Instrumental Variables Estimators Is Affected by Instrument Strength, Instrument Contamination, and Sample SizeValue in Health, 2011
- Risk stratification schemes, anticoagulation use and outcomes: the risk-treatment paradox in patients with newly diagnosed non-valvular atrial fibrillationHeart, 2011
- Potential Misinterpretation of Treatment Effects Due to Use of Odds Ratios and Logistic Regression in Randomized Controlled TrialsPLOS ONE, 2011
- Testing the correlated random coefficient modelJournal of Econometrics, 2010
- Comparing IV with structural models: What simple IV can and cannot identifyJournal of Econometrics, 2010
- Threads and Yarns: Weaving the Tapestry of ComorbidityThe Annals of Family Medicine, 2006
- Rejoinder: Response to SobelSociological Methodology, 2005
- Causal Parameters and Policy Analysis in Economics: A Twentieth Century Retrospective*The Quarterly Journal of Economics, 2000