Impact assessment of citizen science: state of the art and guiding principles for a consolidated approach
Top Cited Papers
Open Access
- 12 May 2021
- journal article
- review article
- Published by Springer Nature in Sustainability Science
- Vol. 16 (5) , 1683-1699
Abstract
Over the past decade, citizen science has experienced growth and popularity as a scientific practice and as a new form of stakeholder engagement and public participation in science or in the generation of new knowledge. One of the key requirements for realising the potential of citizen science is evidence and demonstration of its impact and value. Yet the actual changes resulting from citizen science interventions are often assumed, ignored or speculated about. Based on a systematic review of 77 publications, combined with empirical insights from 10 past and ongoing projects in the field of citizen science, this paper presents guidelines for a consolidated Citizen Science Impact Assessment framework to help overcome the dispersion of approaches in assessing citizen science impacts; this comprehensive framework enhances the ease and consistency with which impacts can be captured, as well as the comparability of evolving results across projects. Our review is framed according to five distinct, yet interlinked, impact domains (society, economy, environment, science and technology, and governance). Existing citizen science impact assessment approaches provide assessment guidelines unevenly across the five impact domains, and with only a small number providing concrete indicator-level conceptualisations. The analysis of the results generates a number of salient insights which we combine in a set of guiding principles for a consolidated impact assessment framework for citizen science initiatives. These guiding principles pertain to the purpose of citizen science impact assessments, the conceptualisation of data collection methods and information sources, the distinction between relative versus absolute impact, the comparison of impact assessment results across citizen science projects, and the incremental refinement of the organising framework over time.Keywords
Funding Information
- European Commission (776740, 824711)
This publication has 83 references indexed in Scilit:
- On Measuring Community Participation in ResearchHealth Education & Behavior, 2012
- Measuring the Performance of Public-Private PartnershipsPublic Performance & Management Review, 2012
- The art and science of multi-scale citizen science supportEcological Informatics, 2011
- Evaluation of stakeholder participation in monitoring regional sustainable developmentRegional Environmental Change, 2011
- Assessing the outcomes of participatory research: protocol for identifying, selecting, appraising and synthesizing the literature for realist reviewImplementation Science, 2011
- Measuring the impact of programs that challenge the public stigma of mental illnessClinical Psychology Review, 2010
- Three Approaches to Monitoring: Feedback Systems, Participatory Monitoring and Evaluation and Logical FrameworksIDS Bulletin, 2010
- Newspaper content analysis in evaluation of a community-based participatory project to increase physical activityHealth Education Research, 2009
- Developing and applying a framework to evaluate participatory research for sustainabilityEcological Economics, 2007
- The Neighborhood Nestwatch Program: Participant Outcomes of a Citizen‐Science Ecological Research ProjectConservation Biology, 2005