A scoping review of engineering education systematic reviews
Open Access
- 13 July 2023
- journal article
- research article
- Published by Wiley in Journal of Engineering Education
- Vol. 113 (4) , 818-837
Abstract
Background: Systematic review or systematic literature review (SLR) methodologies are a powerful tool for evidence‐based decision making. The method originated in the medical sciences but has since been adopted by other disciplines, including engineering education (EE).Purpose: We aimed to answer two research questions: (i) To what extent is the SLR research method being applied in EE? (ii) How closely are SLRs published in EE following established reporting guidelines for the methodology?Scope/Method: We searched Inspec, Compendex, and ERIC for engineering‐related SLRs and meta‐analyses (MAs). We included English language papers that contained an explicit SLR search, or where it appeared the methodology was intended by the author(s). We completed a data extraction process for 21 descriptive and quality‐related items, including engineering discipline, which allowed us to identify the EE studies analyzed in this article.Results: This sub‐analysis presents the results of 276 EE‐related reviews. We found the use of SLR/MA methods is growing in EE, with 93% of papers published during 2015–2022. However, we found that authors are not generally following established guidelines for reporting their methods and findings.Conclusions: Not following the best practices for conducting and reporting SLRs can result in the presentation of incorrect summaries and analyses due to missed evidence. Including search experts (e.g., librarians) trained in conducting SLRs can improve review quality. There is also an opportunity for EE‐related publishers to recruit experts trained in conducting SLRs as peer reviewers to participate in evaluating submitted reviews.Keywords
This publication has 39 references indexed in Scilit:
- Systematic Literature Reviews in Engineering Education and Other Developing Interdisciplinary FieldsJournal of Engineering Education, 2014
- Who was James Lind, and what exactly did he achieveJournal of the Royal Society of Medicine, 2012
- Best Practice in Systematic Reviews: The Importance of Protocols and RegistrationPLOS Medicine, 2011
- Archie Cochrane and His Vision for Evidence-Based MedicinePlastic and Reconstructive Surgery, 2009
- A typology of reviews: an analysis of 14 review types and associated methodologiesHealth Information & Libraries Journal, 2009
- Systematic literature reviews in software engineering – A systematic literature reviewInformation and Software Technology, 2009
- Scoping studies: towards a methodological frameworkInternational Journal of Social Research Methodology, 2005
- The politics of evidence and methodology: lessons from the EPPI-CentreEvidence & Policy, 2005
- Towards a Methodology for Developing Evidence‐Informed Management Knowledge by Means of Systematic ReviewBritish Journal of Management, 2003
- Effects of Small-Group Learning on Undergraduates in Science, Mathematics, Engineering, and Technology: A Meta-AnalysisReview of Educational Research, 1999