Using supervised machine learning to quantify cleaning behaviour
Oliveira, R.; Garcia, N. C.; Paula, J. R.
Show abstract
Cleaner fish engage in mutualistic interactions by removing ectoparasites from client species, a behaviour that has traditionally been quantified through labour-intensive manual video analysis. This method is not only time-consuming but also susceptible to human error and bias. In this study, we developed a semi-automated system to track and classify cleaning interactions between the cleaner wrasse (Labroides dimidiatus) and the powder blue tang (Acanthurus leucosternon) in a controlled three-dimensional laboratory setting. We employed DeepLabCut (DLC), a deep learning-based tool for markerless pose estimation, to track both fish species simultaneously. The resulting model reliably tracked both individuals with low error rates. Using the tracking data, we designed a classification algorithm that detected cleaning interactions with 90% accuracy. Although the algorithm misclassified approximately 15% of non-interactions as interactions, it successfully identified 25% of video content as containing interactions, thereby reducing the amount of footage requiring manual annotation by 75%. This approach significantly decreases human labour while maintaining high classification performance. Overall, our system represents a valuable step toward automating behavioural analysis in marine mutualisms and can serve as a foundation for broader applications in ethology and conservation research.
Matching journals
The top 2 journals account for 50% of the predicted probability mass.
Similar papers in this journal
- Bird song comparison using deep learning trained from avian perceptual judgments 94%
- Visualization and quantification of coral reef soundscapes using CoralSoundExplorer software 93%
- Capturing the songs of mice with an improved detection and classification method for ultrasonic vocalizations (BootSnap) 92%
Similar papers in this journal
- GoFish: A low-cost, open-source platform for closed-loop behavioural experiments on fish 95%
- Visual Field Analysis: a reliable method to score left- and right eye-use using automated tracking 94%
- My friend MIROSLAV: A Hackable Open-Source Hardware and Software Platform for High-Throughput Rodent Activity Monitoring in the Home Cage 92%
Similar papers in this journal
- Machine learning goes wild: Using data from captive individuals to infer wildlife behaviour 95%
- Automated, Stress-Free, and Precise Measurement of Songbird Weight in Neuroscience Experiments 94%
- Tracking individual honeybees among wildflower clusters with computer vision-facilitated pollinator monitoring 94%
Similar papers in this journal
- BonZeb: Open-source, modular software tools for high-resolution zebrafish tracking and analysis 95%
- An Assistive Computer Vision Tool to Automatically Detect Changes in Fish Behavior In Response to Ambient Odor 95%
- Driving singing behaviour in songbirds using multi-modal, multi-agent virtual reality 94%
"Similar papers" are the closest papers from that journal in the model's embedding space. They show what the match is built on, but the ranking comes mostly from a classifier over the whole training set, not from these examples alone.