Data Reliability in a Citizen Science Protocol for Monitoring Stingless Bees Flight Activity
Open Access
Abstract
Although the quality of citizen science (CS) data is often a concern, evidence for high-quality CS data increases in the scientific literature. This study aimed to assess the data reliability of a structured CS protocol for monitoring stingless bees’ flight activity. We tested (1) data accuracy for replication among volunteers and for expert validation and (2) precision, comparing dispersion between citizen scientists and expert data. Two distinct activity dimensions were considered: (a) perception of flight activity and (b) flight activity counts (entrances, exits, and pollen load). No significant differences were found among groups regarding entrances and exits. However, replicator citizen scientists presented a higher chance of perceiving pollen than original data collectors and experts, likely a false positive. For those videos in which there was an agreement about pollen presence, the effective pollen counts were similar (with higher dispersion for citizen scientists), indicating the reliability of CS-collected data. The quality of the videos, a potential source of variance, did not influence the results. Increasing practical training could be an alternative to improve pollen data quality. Our study shows that CS provides reliable data for monitoring bee activity and highlights the relevance of a multi-dimensional approach for assessing CS data quality.Keywords
Funding Information
- Fundação de Amparo à Pesquisa do Estado de São Paulo (2018/14994-1, 2019/26760-8)
- Coordenação de Aperfeiçoamento de Pessoal de Nível Superior (88882.333367/2019-01, 88882.377160/2019-01)
- Conselho Nacional de Desenvolvimento Científico e Tecnológico (312.605/2018-8)
This publication has 57 references indexed in Scilit:
- A morphologically specialized soldier caste improves colony defense in a neotropical eusocial beeProceedings of the National Academy of Sciences, 2012
- Assessing citizen science data quality: an invasive species case studyConservation Letters, 2011
- Optimising biodiversity assessments by volunteers: The application of occupancy modelling to large-scale amphibian surveysBiological Conservation, 2010
- A new dawn for citizen scienceTrends in Ecology & Evolution, 2009
- Buckets of Resistance: Standards and the Effectiveness of Citizen ScienceScience, Technology, & Human Values, 2009
- How Many Scientists Fabricate and Falsify Research? A Systematic Review and Meta-Analysis of Survey DataPLOS ONE, 2009
- Advantages of Volunteer‐Based Biodiversity Monitoring in EuropeConservation Biology, 2009
- Image quality assessment: from error visibility to structural similarityIEEE Transactions on Image Processing, 2004
- The value of marine ecological data collected by volunteersBiological Conservation, 2003
- Data quality assessmentCommunications of the ACM, 2002