Observational research rigour alone does not justify causal inference
- 6 October 2016
- journal article
- research article
- Published by Wiley in European Journal of Clinical Investigation
- Vol. 46 (12) , 985-993
Abstract
Background: Differing opinions exist on whether associations obtained in observational studies can be reliable indicators of a causal effect if the observational study is sufficiently well controlled and executed.Materials and methods: To test this, we conducted two animal observational studies that were rigorously controlled and executed beyond what is achieved in studies of humans. In study 1, we randomized 332 genetically identical C57BL/6J mice into three diet groups with differing food energy allotments and recorded individual self‐selected daily energy intake and lifespan. In study 2, 60 male mice (CD1) were paired and divided into two groups for a 2‐week feeding regimen. We evaluated the association between weight gain and food consumption. Within each pair, one animal was randomly assigned to an S group in which the animals had free access to food. The second paired animal (R group) was provided exactly the same diet that their S partner ate the day before.Results: In study 1, across all three groups, we found a significant negative effect of energy intake on lifespan. However, we found a positive association between food intake and lifespan among the ad libitum feeding group: 29·99 (95% CI: 8·2–51·7) days per daily kcal. In study 2, we found a significant (P = 0·003) group (randomized vs. self‐selected)‐by‐food consumption interaction effect on weight gain.Conclusion: At least in nutrition research, associations derived from observational studies may not be reliable indicators of causal effects, even with the most rigorous study designs achievable.Keywords
Funding Information
- National Institutes of Health (R01AG033682, P30DK056336, P30AG050886)
This publication has 24 references indexed in Scilit:
- Prospective Observational Studies to Assess Comparative Effectiveness: The ISPOR Good Research Practices Task Force ReportValue in Health, 2012
- Meta-analyses of Adverse Effects Data Derived from Randomised Controlled Trials as Compared to Observational Studies: Methodological OverviewPLOS Medicine, 2011
- Use of Causal Language in Observational Studies of Obesity and NutritionObesity Facts, 2010
- Can Nonrandomized Experiments Yield Accurate Answers? A Randomized Experiment Comparing Random and Nonrandom AssignmentsJournal of the American Statistical Association, 2008
- Does obesity shorten life? The importance of well-defined interventions to answer causal questionsInternational Journal of Obesity, 2008
- Revisiting the omitted variables argument: Substantive vs. statistical adequacyJournal of Economic Methodology, 2006
- Randomized, Controlled Trials, Observational Studies, and the Hierarchy of Research DesignsNew England Journal of Medicine, 2000
- A Comparison of Observational Studies and Randomized, Controlled TrialsNew England Journal of Medicine, 2000
- Estimating Causal Effects from Large Data Sets Using Propensity ScoresAnnals of Internal Medicine, 1997
- The concept of residual confounding in regression models and some applicationsStatistics in Medicine, 1992