Towards Automatic Cetacean Photo-Identification: A Framework for Fine-Grain, Few-Shot Learning in Marine Ecology
Authors:
- Cameron TrotterCTCameron Trotter
- Nick WrightNWNick Wright
- A. Stephen McGoughAMA. Stephen McGough
- Matt SharpeMSMatt Sharpe
- Barbara CheneyBCBarbara Cheney
- Mònica Arso CivilMCMònica Arso Civil
- Reny Tyson MooreRMReny Tyson Moore
- Jason AllenJAJason Allen
- Per BerggrenPBPer Berggren
Preprint
Abstract
Photo-identification (photo-id) is one of the main non-invasive capture-recapture methods utilised by marine researchers for monitoring cetacean (dolphin, whale, and porpoise) populations. This method has historically been performed manually resulting in high workload and cost due to the vast number of images collected. Recently automated aids have been developed to help speed-up photo-id, although they are often disjoint in their processing and do not utilise all available identifying information. Work presented in this paper aims to create a fully automatic photo-id aid capable of providing most likely matches based on all available information without the need for data pre-processing such as cropping. This is achieved through a pipeline of computer vision models and post-processing techniques aimed at detecting cetaceans in unedited field imagery before passing them downstream for individual level catalogue matching. The system is capable of handling previously uncatalogued individuals and flagging these for investigation thanks to catalogue similarity comparison. We evaluate the system against multiple real-life photo-id catalogues, achieving mAP@IOU[0.5] = 0.91, 0.96 for the task of dorsal fin detection on catalogues from Tanzania and the UK respectively and 83.1, 97.5% top-10 accuracy for the task of individual classification on catalogues from the UK and USA.Keywords
All Related Versions
This publication has 19 references indexed in Scilit:
- Two-view fine-grained classification of plant speciesNeurocomputing, 2022
- catRlog: a photo-identification project management system based in RMammalian Biology, 2021
- Indian Ocean humpback dolphin in the Menai Bay off the south coast of Zanzibar, East Africa is Critically EndangeredAquatic Conservation: Marine and Freshwater Ecosystems, 2019
- Changing distribution of the east coast of Scotland bottlenose dolphin population and the challenges of area‐based managementAquatic Conservation: Marine and Freshwater Ecosystems, 2019
- DolFin: an innovative digital platform for studying Risso’s dolphins in the Northern Ionian Sea (North-eastern Central Mediterranean)Scientific Reports, 2018
- Integral Curvature Representation and Matching Algorithms for Identification of Dolphins and Whales2017
- Deep Residual Learning for Image Recognition2016
- Long-term trends in the use of a protected area by small cetaceans in relation to changes in population statusGlobal Ecology and Conservation, 2014
- Microsoft COCO: Common Objects in Context2014
- Speeded-Up Robust Features (SURF)Computer Vision and Image Understanding, 2008