Monte Carlo simulations to propagate the uncertainty of machine-learning classification into ecological models
Monchy, C.; Gimenez, O.; Le Bohec, C.; Bardon, G.; Etienne, M.-P.
Show abstract
Deep learning (DL) is increasingly integrated into quantitative ecology, particularly for automating the classification of sensor data in biodiversity monitoring. In addition to substantially reducing data processing effort, DL models often achieve high classification performance. However, despite ongoing improvements, certain species or classification tasks remain challenging, and predictions are rarely error-free. Manual verification is frequently included into data processing pipelines to mitigate misclassifications, but this approach may mask rather than quantify uncertainty. Here, we propose directly incorporating classification uncertainty into ecological inference, rather than filtering it afterwards. Specifically, we treat model predictions as probabilistic outputs rather than fixed class assignments, by using Monte Carlo simulations to propagate uncertainty from the classification process into downstream ecological models. We illustrate this approach using two case studies. The first estimates stochastic population growth rates for a penguin population using detection time series derived from Radio Frequency IDentification (RFID). The second propagates uncertainty in species identification from camera trap images into occupancy estimates. For both, we compare results obtained propagating classification uncertainty with those from conventional single-class attribution at two confidence score thresholds. Our findings show that propagating uncertainty typically leads to higher, more optimistic ecological estimates compared to the single-class confidence approach. Importantly, this method expands the total uncertainty interval by explicitly introducing the confidence score produced by automatic classification as a representation of uncertainty. Quantifying this uncertainty in parameter estimation allows for more informed and reliable ecological interpretations. Monte Carlo simulations offer a flexible and accessible means to integrate classification uncertainty into diverse ecological modelling workflows.
Matching journals
The top 1 journal accounts for 50% of the predicted probability mass.
Similar papers in this journal
- Analysing biodiversity observation data collected in continuous time: Should we use discrete- or continuous-time occupancy models? 98%
- Assessing predictive accuracy of species abundance models in dynamic systems 96%
- Dynamic Generalised Additive Models (DGAM) for forecasting discrete ecological time series 96%
Similar papers in this journal
- Accounting for unobserved population dynamics and aging error in close-kin mark-recapture assessments 95%
- Using known births to account for delayed marking in population estimation of North Atlantic right whales 94%
- Modeling the demography of species providing extended parental care: A capture-recapture multievent model with a case study on Polar Bears (Ursus maritimus) 94%
Similar papers in this journal
- Using informative priors to account for identifiability issues in occupancy models with identification errors 97%
- Accounting for observation biases associated with counts of young when estimating fecundity: case study on the arboreal-nesting red kite (Milvus milvus) 97%
- Mark loss can strongly bias demographic rates in multi-state models: a case study with simulated and empirical datasets 96%
Similar papers in this journal
Similar papers in this journal
"Similar papers" are the closest papers from that journal in the model's embedding space. They show what the match is built on, but the ranking comes mostly from a classifier over the whole training set, not from these examples alone.