Reproducibility of Literature Search Reporting in Medical Education Reviews
- 1 August 2011
- journal article
- Published by Oxford University Press (OUP) in Academic Medicine
- Vol. 86 (8) , 1049-1054
Abstract
Medical education literature has been found to lack key components of scientific reporting, including adequate descriptions of literature searches, thus preventing medical educators from replicating and building on previous scholarship. The purpose of this study was to examine the reproducibility of search strategies as reported in medical education literature reviews. The authors searched for and identified literature reviews published in 2009 in Academic Medicine, Teaching and Learning in Medicine, and Medical Education. They searched for citations whose titles included the words "meta-analysis," "systematic literature review," "systematic review," or "literature review," or whose publication type MEDLINE listed as "meta-analysis" or "review." The authors created a checklist to identify key characteristics of literature searches and of literature search reporting within the full text of the reviews. The authors deemed searches reproducible only if the review reported both a search date and Boolean operators. Of the 34 reviews meeting the inclusion criteria, 19 (56%) explicitly described a literature search and mentioned MEDLINE; however, only 14 (41%) also mentioned searches of nonmedical databases. Eighteen reviews (53%) listed search terms, but only 6 (18%) listed Medical Subject Headings, and only 2 (6%) mentioned Boolean operators. Fifteen (44%) noted the use of limits. None of the reviews included reproducible searches. According to this analysis, literature search strategies in medical education reviews are highly variable and generally not reproducible. The authors provide recommendations to facilitate future high-quality, transparent, and reproducible literature searches.Keywords
This publication has 25 references indexed in Scilit:
- An evidence-based practice guideline for the peer review of electronic search strategiesJournal of Clinical Epidemiology, 2009
- The PRISMA Statement for Reporting Systematic Reviews and Meta-Analyses of Studies That Evaluate Health Care Interventions: Explanation and ElaborationPLOS Medicine, 2009
- Personal Digital Assistants: A Review of Current and Potential Utilization Among Medical ResidentsTeaching and Learning in Medicine, 2009
- Feedback by simulated patients in undergraduate medical education: a systematic review of the literatureMedical Education, 2009
- Proposed Standards for Medical Education Submissions to the Journal of General Internal MedicineJournal of General Internal Medicine, 2008
- Description, justification and clarification: a framework for classifying the purposes of research in medical educationMedical Education, 2008
- Developing scholarly projects in education: A primer for medical teachersMedical Teacher, 2007
- The Literature Review: Demystifying the Literature SearchThe Diabetes Educator, 2004
- Evidence‐based education: development of an instrument to critically appraise reports of educational interventionsMedical Education, 1999
- Guidelines for evaluating papers on educational interventionsBMJ, 1999