PEER-REVIEWED JOURNAL EDITORS’ VIEWS ON REAL-WORLD EVIDENCE
Open Access
- 8 February 2018
- journal article
- research article
- Published by Cambridge University Press (CUP) in International Journal of Technology Assessment in Health Care
- Vol. 34 (1) , 111-119
Abstract
Objectives:Peer-review publication is a critical step to the translation and dissemination of research results into clinical practice guidelines, health technology assessment (HTA) and payment policies, and clinical care. The objective of this study was to examine current views of journal editors regarding: (i) The value of real-world evidence (RWE) and how it compares with other types of studies; (ii) Education and/or resources journal editors provide to their peer reviewers or perceive as needed for authors, reviewers, and editors related to RWE.Methods:Journal editors’ views on the value of RWE and editorial procedures for RWE manuscripts were obtained through telephone interviews, a survey, and in-person, roundtable discussion.Results:In total, seventy-nine journals were approached, resulting in fifteen telephone interviews, seventeen survey responses and eight roundtable participants. RWE was considered valuable by all interviewed editors (n= 15). Characteristics of high-quality RWE manuscripts included: novelty/relevance, rigorous methodology, and alignment of data to research question. Editors experience challenges finding peer reviewers; however, these challenges persist across all study designs. Journals generally do not provide guidance, assistance, or training for reviewers, including for RWE studies. Health policy/health services research (HSR) editors were more likely than specialty or general medicine editors to participate in this study, potentially indicating that HSR researchers are more comfortable/interested in RWE.Conclusions:Editors report favorable views of RWE studies provided studies examine important questions and are methodologically rigorous. Improving peer-review processes across all study designs, has the potential to improve the evidence base for decision making, including HTA.Keywords
This publication has 32 references indexed in Scilit:
- Systematic reviews showed insufficient evidence for clinical practice in 2004: what about in 2011? The next appeal for the evidence‐based medicine ageJournal of Evaluation in Clinical Practice, 2012
- Building useful evidence: changing the clinical research paradigm to account for comparative effectiveness researchJournal of Comparative Effectiveness Research, 2012
- Continuous Patient Engagement in Comparative Effectiveness ResearchJAMA, 2012
- A survey of orthopaedic journal editors determining the criteria of manuscript selection for publicationJournal of Orthopaedic Surgery and Research, 2011
- Authors’ and Editors’ Perspectives on Peer Review Quality in Three Scholarly Nursing JournalsJournal of Nursing Scholarship, 2010
- The Challenge of Selection Bias and Confounding in Palliative Care ResearchJournal of Palliative Medicine, 2009
- What errors do peer reviewers detect, and does training improve their ability to detect them?Journal of the Royal Society of Medicine, 2008
- Is There a Dark Phase of This STROBE?Epidemiology, 2007
- Using Real-World Data for Coverage and Payment Decisions: The ISPOR Real-World Data Task Force ReportValue in Health, 2007
- Randomized, Controlled Trials, Observational Studies, and the Hierarchy of Research DesignsNew England Journal of Medicine, 2000