Reporting guidelines and journal quality in otolaryngology
- 9 February 2016
- journal article
- Published by Wiley in Clinical Otolaryngology
- Vol. 41 (5) , 461-466
Abstract
Objectives: Journals increasingly use reporting guidelines to standardise research papers, partly to improve quality. Although defining journal quality is difficult, various calculated metrics are used. This study investigates guideline adoption by otolaryngology journals and whether a relationship exists between this and journal quality.Design, Setting, Participants: Retrospective MEDLINE database review for English language, Index Medicus, journals of interest to otolaryngologists (October 2013).Main Outcome Measures: The resulting journals were examined for the number of guidelines endorsed and then tabulated against surrogate measures of journal quality (Impact factor, Eigenfactor, SCImago, Source‐Normalised rank).The primary outcome measure was the number of recognised reporting guidelines endorsed per journal. This was then correlated against journal quality scores. For comparison, a further small sample correlation was performed with 6 randomly selected and 6 high‐profile clinical non‐otolaryngology journals.Results: 37 otolaryngology journals were identified. Number of guidelines used and quality scores were not normally distributed. Mean guideline usage was 1.0 for otolaryngology journals, 1.5 for randomly selected, and 5.5 for the high‐profile journals. Only 18/37 (49%) otolaryngology journals endorsed any guidelines, compared with 11/12 non‐otolaryngology journals. Within otolaryngology, Eigenfactor positively correlated with guideline use (r = 0.4, n = 44, p < 0.01) otherwise no correlation was found between guideline endorsement and journal quality.Conclusions: Reporting guideline endorsement within otolaryngology journals is low. Although it might be expected that use of reporting guidelines improved quality, this is not reflected in the derived quality scores in otolaryngology. This may reflect low levels of use/enforcement, that quality indicators are inherently flawed, or that generalised guidelines are not always appropriate or valued by editors.Keywords
This publication has 14 references indexed in Scilit:
- Association of Study Quality with Completeness of Reporting: Have Completeness of Reporting and Quality of Systematic Reviews and Meta-Analyses in Major Radiology Journals Changed Since Publication of the PRISMA Statement?Radiology, 2013
- A further step forward in measuring journals’ scientific prestige: The SJR2 indicatorJournal of Informetrics, 2012
- Does journal endorsement of reporting guidelines influence the completeness of reporting of health research? A systematic review protocolSystematic Reviews, 2012
- Are Peer Reviewers Encouraged to Use Reporting Guidelines? A Survey of 116 Health Research JournalsPLOS ONE, 2012
- Endorsement of the CONSORT Statement by High-Impact Medical Journals in China: A Survey of Instructions for Authors and Published PapersPLOS ONE, 2012
- Impact of CONSORT extension for cluster randomised trials on quality of reporting and study methodology: review of random sample of 300 trials, 2000-8BMJ, 2011
- The source normalized impact per paper is a valid and sophisticated indicator of journal citation impactJournal of the American Society for Information Science and Technology, 2010
- A catalogue of reporting guidelines for health researchEuropean Journal of Clinical Investigation, 2009
- A Principal Component Analysis of 39 Scientific Impact MeasuresPLOS ONE, 2009
- Improving the Quality of Reporting of Randomized Controlled TrialsJAMA, 1996