Association of Accuracy, Conclusions, and Reporting Completeness With Acceptance by Radiology Conferences and Journals
Authors:
- Robert A. FrankRFRobert A. Frank
- Matthew D. F. McInnesMMMatthew D. F. McInnes
- The UnBIAS Research GroupTGThe UnBIAS Research Group
- 8 January 2022
- journal article
- research article
- Published by Wiley in Journal of Magnetic Resonance Imaging
- Vol. 56 (2) , 380-390
Abstract
Background: Preferential publication of studies with positive findings can lead to overestimation of diagnostic test accuracy (i.e. publication bias). Understanding the contribution of the editorial process to publication bias could inform interventions to optimize the evidence guiding clinical decisions.Purpose/Hypothesis: To evaluate whether accuracy estimates, abstract conclusion positivity, and completeness of abstract reporting are associated with acceptance to radiology conferences and journals.Study Type: Meta‐research.Population: Abstracts submitted to radiology conferences (European Society of Gastrointestinal and Abdominal Radiology (ESGAR) and International Society for Magnetic Resonance in Medicine (ISMRM)) from 2008 to 2018 and manuscripts submitted to radiology journals (Radiology, Journal of Magnetic Resonance Imaging [JMRI]) from 2017 to 2018. Primary clinical studies evaluating sensitivity and specificity of a diagnostic imaging test in humans with available editorial decisions were included.Assessment: Primary variables (Youden's index [YI > 0.8 vs. P‐values were obtained; the threshold for statistical significance was P < 0.05.Results: A total of 1000 conference abstracts (500 ESGAR and 500 ISMRM) and 1000 journal manuscripts (505 Radiology and 495 JMRI) were included. Conference abstract acceptance was not significantly associated with YI (adjusted OR = 0.97 for YI > 0.8; CI = 0.70–1.35), conclusion positivity (OR = 1.21 for positive conclusions; CI = 0.75–1.90) or STARD for Abstracts adherence (OR = 0.96 per unit increase in reported items; CI = 0.82–1.18). Manuscripts with positive abstract conclusions were less likely to be accepted by radiology journals (OR = 0.45; CI = 0.24–0.86), while YI (OR = 0.85; CI = 0.56–1.29) and STARD for Abstracts adherence (OR = 1.06; CI = 0.87–1.30) showed no significant association. Positive conclusions were present in 86.7% of submitted conference abstracts and 90.2% of journal manuscripts.Data Conclusion: Diagnostic test accuracy studies with positive findings were not preferentially accepted by the evaluated radiology conferences or journals.Evidence Level: 3Technical Efficacy: Stage 2.Keywords
Funding Information
- Philips
- University of Ottawa
This publication has 35 references indexed in Scilit:
- Extent of Non-Publication in Cohorts of Studies Approved by Research Ethics Committees or Included in Trial RegistriesPLOS ONE, 2014
- Why Are Medical and Health-Related Studies Not Being Published? A Systematic Review of Reasons Given by InvestigatorsPLOS ONE, 2014
- Is there a solution to publication bias? Researchers call for changes in dissemination of clinical research resultsJournal of Clinical Epidemiology, 2014
- Role of Editorial and Peer Review Processes in Publication Bias: Analysis of Drug Trials Submitted to Eight Medical JournalsPLOS ONE, 2014
- Tuning multiple imputation by predictive mean matching and local residual drawsBMC Medical Research Methodology, 2014
- Systematic Review of the Empirical Evidence of Study Publication Bias and Outcome Reporting Bias — An Updated ReviewPLOS ONE, 2013
- Overinterpretation and Misreporting of Diagnostic Accuracy Studies: Evidence of “Spin”Radiology, 2013
- No evidence of bias in the process of publication of diagnostic accuracy studies in stroke submitted as abstractsJournal of Clinical Epidemiology, 2009
- Selective Publication of Antidepressant Trials and Its Influence on Apparent EfficacyNew England Journal of Medicine, 2008
- Reasons for Rejection of Manuscripts Submitted to AJR by International AuthorsAmerican Journal of Roentgenology, 2007