Evidence syntheses in educational technology research: What is not published in English is not visible? A tertiary mapping review
Open Access
- 19 January 2025
- journal article
- review article
- Published by Wiley in Review of Education
- Vol. 13 (1)
Abstract
Evidence syntheses, such as systematic reviews, aim to summarise the current state of research in a field, often using the publication language of a study as a criterion for inclusion or exclusion. However, this has serious implications for capturing evidence from a wider range of geographical areas, and the potential for linguistic bias. In order to explore this issue, a trilingual tertiary mapping review of 446 evidence syntheses within the field of educational technology (EdTech) and published in English, Spanish and German was undertaken, analysing the frequency of multi‐ and monolingual evidence syntheses, reasons for language choice by research teams, and the composition of research teams in multi‐ and monolingual evidence syntheses. Items were included if they were a form of evidence synthesis with an explicit method section, indexed within ERIC, Scopus, Web of Science, Dialnet, FIS‐Bildung, or Google Scholar, education‐related, and published between 1983 and May 2022. The results showed that only eight languages were considered in published syntheses, only five languages were used to construct search strings, most evidence syntheses included research published in English without explaining why, and multilingual research team composition did not predict multilingual evidence syntheses. The findings suggest the need to address publication languages not only as a formal criterion but as an integral aspect of methodological approach, influencing the content and scope of syntheses in educational research.Keywords
This publication has 65 references indexed in Scilit:
- Educational Interventions to Improve Dental Anatomy Carving Ability of Dental Students: A Systematic ReviewAnatomical Sciences Education, 2020
- Systematic Reviews in Educational Research2020
- Systematic Reviews in Educational Research: Methodology, Perspectives and Application2019
- Which academic search systems are suitable for systematic reviews or meta‐analyses? Evaluating retrieval qualities of Google Scholar, PubMed, and 26 other resourcesResearch Synthesis Methods, 2019
- Unpacking teachers’ intentions to integrate technology: A meta-analysisEducational Research Review, 2019
- Exploring four decades of research in Computers & EducationComputers & Education, 2018
- A systematic literature review of literature reviews in software testingInformation and Software Technology, 2016
- The role of policy in constructing the peripheral scientist in the era of globalizationLanguage Policy, 2013
- Systematic literature reviews in software engineering – A systematic literature reviewInformation and Software Technology, 2009
- The international student exchange network: 1970 & 1989Higher Education, 1995