Back

Benchmarking for the automated detection and classification of southern yellow-cheeked crested gibbon calls from passive acoustic monitoring data

Clink, D. J.; Cross-Jaya, H.; Kim, J.; Ahmad, A. H.; Hong, M.; Sala, R.; Birot, H.; Agger, C.; Vu, T. T.; Thi, H. N.; Chi, T. N.; Klinck, H.

2024-08-19 ecology
10.1101/2024.08.17.608420 bioRxiv
Show abstract

Recent advances in deep and transfer learning have revolutionized our ability for the automated detection and classification of acoustic signals from long-term recordings. Here, we provide a benchmark for the automated detection of southern yellow-cheeked crested gibbon (Nomascus gabriellae) calls collected using autonomous recording units (ARUs) in Andoung Kraleung Village, Cambodia. We compared the performance of support vector machines (SVMs), a quasi-DenseNet architecture (Koogu), transfer learning with pretrained convolutional neural network (ResNet50) models trained on the ImageNet dataset, and transfer learning with embeddings from a global birdsong model (BirdNET) based on an EfficientNet architecture. We also investigated the impact of varying the number of training samples on the performance of these models. We found that BirdNET had superior performance with a smaller number of training samples, whereas Koogu and ResNet50 models only had acceptable performance with a larger number of training samples (>200 gibbon samples). Effective automated detection approaches are critical for monitoring endangered species, like gibbons. It is unclear how generalizable these results are for other signals, and future work on other vocal species will be informative. Code and data are publicly available for future benchmarking.

Matching journals

The top 3 journals account for 50% of the predicted probability mass.

50% of probability mass above

"Similar papers" are the closest papers from that journal in the model's embedding space. They show what the match is built on, but the ranking comes mostly from a classifier over the whole training set, not from these examples alone.