Autonomous Temporal Pseudo-Labeling for Fish Detection
Open Access
- 10 June 2022
- journal article
- research article
- Published by MDPI AG in Applied Sciences
- Vol. 12 (12) , 5910
Abstract
The first major step in training an object detection model to different classes from the available datasets is the gathering of meaningful and properly annotated data. This recurring task will determine the length of any project, and, more importantly, the quality of the resulting models. This obstacle is amplified when the data available for the new classes are scarce or incompatible, as in the case of fish detection in the open sea. This issue was tackled using a mixed and reversed approach: a network is initiated with a noisy dataset of the same species as our classes (fish), although in different scenarios and conditions (fish from Australian marine fauna), and we gathered the target footage (fish from Portuguese marine fauna; Atlantic Ocean) for the application without annotations. Using the temporal information of the detected objects and augmented techniques during later training, it was possible to generate highly accurate labels from our targeted footage. Furthermore, the data selection method retained the samples of each unique situation, filtering repetitive data, which would bias the training process. The obtained results validate the proposed method of automating the labeling processing, resorting directly to the final application as the source of training data. The presented method achieved a mean average precision of 93.11% on our own data, and 73.61% on unseen data, an increase of 24.65% and 25.53% over the baseline of the noisy dataset, respectively.Keywords
Funding Information
- project KTTSeaDrones (0622_KTTSEADRONES_5_E, POSEUR-03-2215-FC-000046, UIDB/04326/2020, UIDP/04326/2020, UIDB/50009/2020, LA/P/0101/2020, UI/BD/151307/2021)
- PO SEUR program (0622_KTTSEADRONES_5_E, POSEUR-03-2215-FC-000046, UIDB/04326/2020, UIDP/04326/2020, UIDB/50009/2020, LA/P/0101/2020, UI/BD/151307/2021)
- FCT—Foundation for Science and Technology (0622_KTTSEADRONES_5_E, POSEUR-03-2215-FC-000046, UIDB/04326/2020, UIDP/04326/2020, UIDB/50009/2020, LA/P/0101/2020, UI/BD/151307/2021)
This publication has 43 references indexed in Scilit:
- DeepFish: Accurate underwater live fish recognition with a deep architectureNeurocomputing, 2016
- Fish4Knowledge: Collecting and Analyzing Massive Coral Reef Fish Video Data2016
- Fast R-CNN2015
- LifeCLEF 2015: Multimedia Life Species Identification Challenges2015
- Global ecological impacts of invasive species in aquatic ecosystemsGlobal Change Biology, 2015
- Spatial Pyramid Pooling in Deep Convolutional Networks for Visual RecognitionIEEE Transactions on Pattern Analysis and Machine Intelligence, 2015
- Automated Detection of Rockfish in Unconstrained Underwater Videos Using Haar Cascades and a New Image Dataset: Labeled Fishes in the Wild2015
- The Pascal Visual Object Classes Challenge: A RetrospectiveInternational Journal of Computer Vision, 2014
- Underwater video techniques for observing coastal marine biodiversity: A review of sixty years of publications (1952–2012)Fisheries Research, 2014
- Support vector machinesIEEE Intelligent Systems and their Applications, 1998