Causal and Associational Language in Observational Health Research: A systematic evaluation
Authors:
- Noah A. HaberNHNoah A. Haber
- Sarah E. WietenSWSarah E. Wieten
- Julia M. RohrerJRJulia M. Rohrer
- Onyebuchi A. ArahOAOnyebuchi A. Arah
- Peter W.G. TennantPTPeter W.G. Tennant
- Elizabeth A. StuartESElizabeth A. Stuart
- Eleanor J. MurrayEMEleanor J. Murray
- Sophie PilleronSPSophie Pilleron
- Sze Tung LamSLSze Tung Lam
- Emily RiedererEREmily Riederer
- Sarah Jane HowcuttSHSarah Jane Howcutt
- Alison E. SimmonsASAlison E. Simmons
Preprint
Abstract
We estimated the degree to which language used in the high profile medical/public health/epidemiology literature implied causality using language linking exposures to outcomes and action recommendations; examined disconnects between language and recommendations; identified the most common linking phrases; and estimated how strongly linking phrases imply causality. We searched and screened for 1,170 articles from 18 high-profile journals (65 per journal) published from 2010-2019. Based on written framing and systematic guidance, three reviewers rated the degree of causality implied in abstracts and full text for exposure/outcome linking language and action recommendations. Reviewers rated the causal implication of exposure/outcome linking language as None (no causal implication) in 13.8%, Weak 34.2%, Moderate 33.2%, and Strong 18.7% of abstracts. The implied causality of action recommendations was higher than the implied causality of linking sentences for 44.5% or commensurate for 40.3% of articles. The most common linking word in abstracts was “associate” (45.7%). Reviewer’s ratings of linking word roots were highly heterogeneous; over half of reviewers rated “association” as having at least some causal implication. This research undercuts the assumption that avoiding “causal” words leads to clarity of interpretation in medical research.Keywords
All Related Versions
- Published version: American Journal of Epidemiology, 191 (12), 2084.
This publication has 26 references indexed in Scilit:
- How readers understand causal and correlational expressions used in news headlines.Journal of Experimental Psychology: Applied, 2017
- Exaggerations and Caveats in Press Releases and Health-Related Science NewsPLOS ONE, 2016
- Scalar Implicatures: The Psychological Reality of ScalesFrontiers in Psychology, 2016
- Interpretation of Results of Studies Evaluating an Intervention Highlighted in Google Health News: A Cross-Sectional Study of NewsPLOS ONE, 2015
- The association between exaggeration in health related science news and academic press releases: retrospective observational studyBMJ, 2014
- Addressing tensions when popular media and evidence-based care collideBMC Medical Informatics and Decision Making, 2013
- Observational studies often make clinical practice recommendations: an empirical evaluation of authors' attitudesJournal of Clinical Epidemiology, 2013
- Authors' Submission Toolkit: A practical guide to getting your research publishedCurrent Medical Research and Opinion, 2010
- Use of Causal Language in Observational Studies of Obesity and NutritionObesity Facts, 2010
- Modern Applied Statistics with S2002