Can Sustainable Development Goal Classification Tools Be Trusted? Analysing the Spanish National Research Council Output on Gender Equality
Open Access
- 18 December 2025
- journal article
- Published by Wiley in Sustainable Development
- Vol. 34 (3) , 4457-4472
Abstract
Evaluating research contributions to the Sustainable Development Goals (SDGs) remains challenging, particularly for SDG 5 (Gender Equality), which is cross‐cutting, thematically complex and apparently underrepresented in scientific output. This study evaluates the abilities and limitations of automated classification systems (Web of Science, Scopus, OpenAlex and OSDG) in identifying SDG 5 related publications, through a case study of the Spanish National Research Council (CSIC) publications between 2018 and 2022. A mixed approach, combining bibliometric analysis and expert review, examined overlaps among sources, alignment with SDG 5 targets and thematic relevance. Results reveal very low agreement across tools, with only 35% of suggested publications validated as truly related. Most addressed only a few specific targets and semantic ambiguities and certain “two‐sided” concepts/areas whose presence did not always indicate alignment with the goal. Findings highlight the need for hybrid approaches that integrate automated detection with expert qualitative evaluation to ensure rigorous SDG evaluation.Keywords
This publication has 24 references indexed in Scilit:
- How Uncertain is the Emergence of Knowledge Related to the United Nations Sustainable Development Goals? An Analysis of Scientific Knowledge Diversification at Utrecht UniversitySustainable Development, 2025
- Countries' research priorities in relation to the Sustainable Development GoalsResearch Policy, 2024
- Gender equality and women’s empowerment: A bibliometric review of the literature on SDG 5 through the management lensJournal of Business Research, 2023
- SDG-Meter: A Deep Learning Based Tool for Automatic Text Classification of the Sustainable Development Goals2022
- Toward Sustainable Organisations2022
- Analysing the factors affecting the incorporation of sustainable development into European Higher Education Institutions' curriculaSustainable Development, 2019
- Assessing research trends related to Sustainable Development Goals: local and global issuesJournal of Cleaner Production, 2019
- A scientometric review of global research on sustainability and sustainable developmentJournal of Cleaner Production, 2018
- Reinforcing the Holistic Perspective of Sustainability: Analysis of the Importance of Sustainability Drivers in OrganizationsCorporate Social Responsibility and Environmental Management, 2017
- Navigating towards sustainable development: A system dynamics approachFutures, 2006