Feasibility and desirability of screening search results from Google Search exhaustively for systematic reviews: A cross‐case analysis
Open Access
- 19 January 2023
- journal article
- research article
- Published by Wiley in Research Synthesis Methods
- Vol. 14 (3) , 427-437
Abstract
A commonly reported challenge of using Google Search to identify studies for a systematic review is the high number of results retrieved. Thus, ‘stopping rules’ are applied when screening, such as screening only the first 100 results. However, recent evidence shows that Google Search estimates a much higher number of results than the viewable number, raising the possibility of exhaustive screening. This study aimed to provide further evidence on the feasibility of screening search results from Google Search exhaustively, and to assess the desirability of this in terms of identifying studies for a systematic review. We conducted a cross‐case analysis of the search results of eight Google Search searches from two systematic reviews. Feasibility of exhaustive screening was ascertained by calculating the viewable number of results. Desirability was ascertained according to: (1) the distribution of studies within the results, irrespective of relevance to a systematic review; (2) the distribution of studies which met the inclusion criteria for the two systematic reviews. The estimated number of results across the eight searches ranged from 342,000 to 72,300,000. The viewable number ranged from 272 to 364. Across the eight searches the distribution of studies was highest in the first 100 results. However, the lowest ranking relevant studies were ranked 227th and 215th for the two systematic reviews. One study per review was identified uniquely from searching Google Search, both within the first 100 results. The findings suggest it is feasible and desirable to screen Google Search results more extensively than commonly reported.Keywords
This publication has 17 references indexed in Scilit:
- Improving clinical care for women with endometriosis: qualitative analysis of women’s and health professionals’ viewsJournal of Psychosomatic Obstetrics & Gynecology, 2019
- Which academic search systems are suitable for systematic reviews or meta‐analyses? Evaluating retrieval qualities of Google Scholar, PubMed, and 26 other resourcesResearch Synthesis Methods, 2019
- Searching for and selecting studies2019
- Barriers and Facilitators to Weight and Lifestyle Management in Women with Polycystic Ovary Syndrome: General Practitioners’ PerspectivesNutrients, 2019
- Searching for studies: a guide to information retrieval for Campbell systematic reviewsCampbell Systematic Reviews, 2017
- Searching for grey literature for systematic reviews: challenges and benefitsResearch Synthesis Methods, 2013
- Physical conditioning as part of a return to work strategy to reduce sickness absence for workers with back painCochrane Database of Systematic Reviews, 2013
- How much searching is enough? Comprehensive versus optimal retrieval for technology assessmentsInternational Journal of Technology Assessment in Health Care, 2010
- Introduction to Information Retrieval2008
- Evaluation of the usefulness of Internet searches to identify unpublished clinical trials for systematic reviewsMedical Informatics and the Internet in Medicine, 2001