Association is not causation: treatment effects cannot be estimated from observational data in heart failure
Open Access
- 1 August 2018
- journal article
- review article
- Published by Oxford University Press (OUP) in European Heart Journal
- Vol. 39 (37) , 3417-3438
Abstract
Treatment ‘effects’ are often inferred from non-randomized and observational studies. These studies have inherent biases and limitations, which may make therapeutic inferences based on their results unreliable. We compared the conflicting findings of these studies to those of prospective randomized controlled trials (RCTs) in relation to pharmacological treatments for heart failure (HF). We searched Medline and Embase to identify studies of the association between non-randomized drug therapy and all-cause mortality in patients with HF until 31 December 2017. The treatments of interest were: angiotensin-converting enzyme inhibitors, angiotensin receptor blockers, beta-blockers, mineralocorticoid receptor antagonists (MRAs), statins, and digoxin. We compared the findings of these observational studies with those of relevant RCTs. We identified 92 publications, reporting 94 non-randomized studies, describing 158 estimates of the ‘effect’ of the six treatments of interest on all-cause mortality, i.e. some studies examined more than one treatment and/or HF phenotype. These six treatments had been tested in 25 RCTs. For example, two pivotal RCTs showed that MRAs reduced mortality in patients with HF with reduced ejection fraction. However, only one of 12 non-randomized studies found that MRAs were of benefit, with 10 finding a neutral effect, and one a harmful effect. This comprehensive comparison of studies of non-randomized data with the findings of RCTs in HF shows that it is not possible to make reliable therapeutic inferences from observational associations. While trials undoubtedly leave gaps in evidence and enrol selected participants, they clearly remain the best guide to the treatment of patients.Keywords
This publication has 157 references indexed in Scilit:
- Statins in Heart Failure: The Paradox Between Large Randomized Clinical Trials and Real LifeMayo Clinic Proceedings, 2012
- Observational cohort study of the safety of digoxin use in women with heart failureBMJ Open, 2012
- The Cochrane Collaboration's tool for assessing risk of bias in randomised trialsBMJ, 2011
- Eplerenone in Patients with Systolic Heart Failure and Mild SymptomsNew England Journal of Medicine, 2011
- Invited Commentary: Assessing Treatment Effects by Using Observational Analyses--Opportunities and LimitationsAmerican Journal of Epidemiology, 2009
- Clinical Effectiveness of Beta-Blockers in Heart FailureJACC, 2009
- Effect of rosuvastatin in patients with chronic heart failure (the GISSI-HF trial): a randomised, double-blind, placebo-controlled trialThe Lancet, 2008
- The Effectiveness of β-blockers in Women With Congestive Heart FailureJournal of General Internal Medicine, 2007
- Estimating Treatment Effects Using Observational DataJAMA, 2007
- Risks and Benefits of Estrogen Plus Progestin in Healthy Postmenopausal Women: Principal Results From the Women's Health Initiative Randomized Controlled TrialJAMA, 2002