Deep learning‐based methods for individual recognition in small birds
Top Cited Papers
Open Access
- 26 July 2020
- journal article
- research article
- Published by Wiley in Methods in Ecology and Evolution
- Vol. 11 (9) , 1072-1085
Abstract
Individual identification is a crucial step to answer many questions in evolutionary biology and is mostly performed by marking animals with tags. Such methods are well‐established, but often make data collection and analyses time‐consuming, or limit the contexts in which data can be collected. Recent computational advances, specifically deep learning, can help overcome the limitations of collecting large‐scale data across contexts. However, one of the bottlenecks preventing the application of deep learning for individual identification is the need to collect and identify hundreds to thousands of individually labelled pictures to train convolutional neural networks (CNNs). Here we describe procedures for automating the collection of training data, generating training datasets, and training CNNs to allow identification of individual birds. We apply our procedures to three small bird species, the sociable weaver Philetairus socius, the great tit Parus major and the zebra finch Taeniopygia guttata, representing both wild and captive contexts. We first show how the collection of individually labelled images can be automated, allowing the construction of training datasets consisting of hundreds of images per individual. Second, we describe how to train a CNN to uniquely re‐identify each individual in new images. Third, we illustrate the general applicability of CNNs for studies in animal biology by showing that trained CNNs can re‐identify individual birds in images collected in contexts that differ from the ones originally used to train the CNNs. Finally, we present a potential solution to solve the issues of new incoming individuals. Overall, our work demonstrates the feasibility of applying state‐of‐the‐art deep learning tools for individual identification of birds, both in the laboratory and in the wild. These techniques are made possible by our approaches that allow efficient collection of training data. The ability to conduct individual recognition of birds without requiring external markers that can be visually identified by human observers represents a major advance over current methods.Keywords
All Related Versions
Funding Information
- Max-Planck-Gesellschaft
- Fundação para a Ciência e a Tecnologia (CEECIND/01970/2017, IF/01411/2014/CP1256/CT0007, PTDC/BIA‐EVF/5249/201, SFRH/BD/122106/2016)
- Agence Nationale de la Recherche (ANR‐ 15‐CE32‐0012‐02, ANR 19‐CE02‐0014‐02)
- Deutsche Forschungsgemeinschaft (FA 1402/4‐1, 422037984)
- Universityof CapeTown
- Max-Planck-Gesellschaft
This publication has 38 references indexed in Scilit:
- Deriving Animal Behaviour from High-Frequency GPS: Tracking Cows in Open and Forested HabitatPLOS ONE, 2015
- Deep learningNature, 2015
- Experimentally induced innovations lead to persistent culture via conformity in wild birdsNature, 2014
- idTracker: tracking individuals in a group by automatic identification of unmarked animalsNature Methods, 2014
- A review of novelty detectionSignal Processing, 2014
- Reality mining of animal social systemsTrends in Ecology & Evolution, 2013
- Individuals and populations: the role of long-term, individual-based studies of animals in ecology and evolutionary biologyTrends in Ecology & Evolution, 2010
- Anomaly detectionACM Computing Surveys, 2009
- Image quality assessment: from error visibility to structural similarityIEEE Transactions on Image Processing, 2004
- A Mathematical Theory of CommunicationBell System Technical Journal, 1948