Monte Carlo simulations to propagate the uncertainty of automated classification into ecological models
Preprint
Abstract
Deep learning (DL) is increasingly integrated into quantitative ecology, particularly for automating the classification of sensor data in biodiversity monitoring. In addition to substantially reducing data processing effort, DL models often achieve high classification performance. However, despite ongoing improvements, certain species or classification tasks remain challenging, and predictions are rarely error-free. Manual verification is frequently included into data processing pipelines to mitigate misclassifications, but this approach may mask rather than quantify uncertainty. Here, we propose directly incorporating classification uncertainty into ecological inference, rather than filtering it afterwards. Specifically, we treat model predictions as probabilistic outputs rather than fixed class assignments, by using Monte Carlo simulations to propagate uncertainty from the classification process into downstream ecological models. We illustrate this approach using two case studies. The first estimates stochastic population growth rates for a penguin population using detection time series derived from Radio Frequency IDentification (RFID). The second propagates uncertainty in species identification from camera trap images into occupancy estimates. For both, we compare results obtained propagating classification uncertainty with those from conventional single-class attribution at two confidence score thresholds. Our findings show that propagating uncertainty typically leads to higher, more optimistic ecological estimates compared to the single-class confidence approach. Importantly, this method expands the total uncertainty interval by explicitly introducing the confidence score produced by automatic classification as a representation of uncertainty. Quantifying this uncertainty in parameter estimation allows for more informed and reliable ecological interpretations. Monte Carlo simulations offer a flexible and accessible means to integrate classification uncertainty into diverse ecological modelling workflows.Keywords
This publication has 48 references indexed in Scilit:
- A classification‐occupancy model based on automatically identified species dataEcology, 2025
- Being confident in confidence scores: calibration in deep learning models for camera trap image sequencesRemote Sensing in Ecology and Conservation, 2024
- Aggregated time‐series features boost species‐specific differentiation of true and false positives in passive acoustic monitoring of bird assemblagesRemote Sensing in Ecology and Conservation, 2024
- Efficacy of machine learning image classification for automated occupancy‐based monitoringRemote Sensing in Ecology and Conservation, 2023
- Deep learning algorithm outperforms experienced human observer at detection of blue whale D‐calls: a double‐observer analysisRemote Sensing in Ecology and Conservation, 2022
- An approach to rapid processing of camera trap images with minimal human inputEcology and Evolution, 2021
- Improving the accessibility and transferability of machine learning algorithms for identification of animals in camera trap images: MLWIC2Ecology and Evolution, 2020
- Dynamic wildlife occupancy models using automated acoustic monitoring dataEcological Applications, 2019
- Scaling‐up camera traps: monitoring the planet's biodiversity with networks of remote sensorsFrontiers in Ecology and the Environment, 2016
- Matrix Population Models2006