A study on edge devices for image classification of the Tasmanian devil (Sarcophilus harrisii) for vaccine delivery
Chaturvedi, P.; Flies, A. S.; Connelly, W. M.
Show abstract
O_LIA target-specific bait dispenser is required for oral bait vaccination of the endangered Tasmanian devil (Sarcophilus harrisii) against the deadly devil facial tumour disease. Development of a broadly extendible dispenser would be a beneficial ecological tool. A camera-based edge device with an onboard deep learning model can be used to identify the target species using image classification. It is important to choose a suitable edge device for the dispensers effective application in power constrained environments. C_LIO_LIWe evaluated four edge devices for the smart bait dispenser-ArduinoPro Nicla Vision, ArduinoPro Portenta H7 with Vision Shield (LoRa), Raspberry Pi 3 Model B+ and Raspberry Pi Zero 2 W. Two simple convolutional neural networks, and four fine-tuned pretrained models (MobileNetV2, MobileNetV3Small, ResNet50V2, and ResNet152V2) were trained on trail camera images of devil and non-devil species. These models were evaluated across four metrics and post-training quantised for deployment. The edge devices were assessed on inference latency of each model in seconds (s) and power consumption in watt (W). C_LIO_LIWe found that a simple CNN based image classification model yielded the best overall result of [~]96% across all metrics. Raspberry Pi 3 Model B+ and Zero 2 W could run all the six models whereas Portenta failed to run the two ResNet models and Nicla Vision failed to run all four pretrained models. All edge devices were found to be quick enough for dispenser application (average inference latency of 0.718 s). Portenta consumed the lowest power during inference (0.19 W), idle (0.185 W), and light sleep (0.045 W) states whereas Nicla Vision consumed the lowest power during deep sleep (0.002 W). C_LIO_LIOverall, we found that simple traditional CNNs was best suited for species classification in a camera-based smart bait dispenser for vaccination of Tasmanian devils. We conclude that ArduinoPro Portenta H7 with Vision Shield is the most competent device for this edge AI application. We suggest integration of this system with a microcontroller unit like ATtiny85 to minimise inactive power consumption of the dispenser. This method can be readily adapted for other species in vaccination and supplemental feeding projects. C_LI
Matching journals
The top 4 journals account for 50% of the predicted probability mass.
Similar papers in this journal
Similar papers in this journal
- Utilizing CNNs for classification and uncertainty quantification for 15 families of European fly pollinators 95%
- Tracking individual honeybees among wildflower clusters with computer vision-facilitated pollinator monitoring 95%
- Detection and measurement of butterfly eyespot and spot patterns using convolutional neural networks 94%
Similar papers in this journal
Similar papers in this journal
- An automated light trap to monitor moths (Lepidoptera) using computer vision-based tracking and deep learning 96%
- High-Throughput and Accurate 3D Scanning of Cattle Using Time-of-Flight Sensors and Deep Learning 94%
- Ethoflow: computer vision and artificial intelligence-based software for automatic behavior analysis 94%
Similar papers in this journal
"Similar papers" are the closest papers from that journal in the model's embedding space. They show what the match is built on, but the ranking comes mostly from a classifier over the whole training set, not from these examples alone.