Back

Location Invariant Animal Recognition UsingMixed Source Datasets and Deep Learning

Shepley, A. J.; Falzon, D. G.; Meek, P.; Kwan, P.

2020-05-15 ecology
10.1101/2020.05.13.094896 bioRxiv
Show abstract

O_LIA time-consuming challenge faced by camera trap practitioners all over the world is the extraction of meaningful data from images to inform ecological management. The primary methods of image processing used by practitioners includes manual analysis and citizen science. An increasingly popular alternative is automated image classification software. However, most automated solutions are not sufficiently robust to be deployed on a large scale. Key challenges include limited access to images for each species and lack of location invariance when transferring models between sites. This prevents optimal use of ecological data and results in significant expenditure of time and resources to annotate and retrain deep learning models. C_LIO_LIIn this study, we aimed to (a) assess the value of publicly available non-iconic FlickR images in the training of deep learning models for camera trap object detection, (b) develop an out-of-the-box location invariant automated camera trap image processing solution for ecologist using deep transfer learning and (c) explore the use of small subsets of camera trap images in optimisation of a FlickR trained deep learning model for high precision ecological object detection. C_LIO_LIWe collected and annotated a dataset of images of "pigs" (Sus scrofa and Phacochoerus africanus) from the consumer image sharing website FlickR. These images were used to achieve transfer learning using a RetinaNet model in the task of object detection. We compared the performance of this model to the performance of models trained on combinations of camera trap images obtained from five different projects, each characterised by 5 different geographical regions. Furthermore, we explored optimisation of the FlickR model via infusion of small subsets of camera trap images to increase robustness in difficult images. C_LIO_LIIn most cases, the mean Average Precision (mAP) of the FlickR trained model when tested on out of sample camera trap sites (67.21-91.92%) was significantly higher than the mAP achieved by models trained on only one geographical location (4.42-90.8%) and rivalled the mAP of models trained on mixed camera trap datasets (68.96-92.75%). The infusion of camera trap images into the FlickR training further improved AP by 5.10-22.32% to 83.60-97.02%. C_LIO_LIEcology researchers can use FlickR images in the training of automated deep learning solutions for camera trap image processing to significantly reduce time and resource expenditure by allowing the development of location invariant, highly robust out-of-the-box solutions. This would allow AI technologies to be deployed on a large scale in ecological applications. C_LI

Matching journals

The top 3 journals account for 50% of the predicted probability mass.

1
Ecological Informatics
29 papers in training set
Top 0.1%
25.9%
2
Remote Sensing in Ecology and Conservation
10 papers in training set
Top 0.1%
17.5%
3
Methods in Ecology and Evolution
160 papers in training set
Top 0.4%
10.1%
50% of probability mass above
4
PLOS ONE
4510 papers in training set
Top 28%
6.4%
5
PLOS Computational Biology
1633 papers in training set
Top 7%
4.9%
6
Ecology and Evolution
232 papers in training set
Top 1.0%
3.6%
7
Scientific Reports
3102 papers in training set
Top 48%
2.4%
8
Global Ecology and Conservation
25 papers in training set
Top 0.5%
1.9%
9
Sensors
39 papers in training set
Top 0.8%
1.9%
10
Nature Communications
4913 papers in training set
Top 51%
1.7%
11
Frontiers in Ecology and Evolution
60 papers in training set
Top 3%
1.3%
12
Ecological Applications
28 papers in training set
Top 0.4%
1.3%
13
Ecography
50 papers in training set
Top 1.0%
0.9%
14
Peer Community Journal
254 papers in training set
Top 3%
0.8%
15
eLife
5422 papers in training set
Top 55%
0.8%
16
Ecological Indicators
20 papers in training set
Top 0.5%
0.8%
17
PeerJ
261 papers in training set
Top 14%
0.8%
18
Molecular Ecology Resources
161 papers in training set
Top 1%
0.7%
19
Movement Ecology
18 papers in training set
Top 0.5%
0.7%
20
Diversity and Distributions
26 papers in training set
Top 0.4%
0.7%
21
Conservation Science and Practice
13 papers in training set
Top 0.5%
0.7%
22
GigaScience
172 papers in training set
Top 3%
0.7%
23
iScience
1063 papers in training set
Top 37%
0.6%