Using ensemble methods to improve the robustness of deep learning for image classification in marine environments
Open Access
- 18 March 2022
- journal article
- research article
- Published by Wiley in Methods in Ecology and Evolution
- Vol. 13 (6) , 1317-1328
Abstract
Deep learning has been shown to be effective for classification of coral in benthic imagery, and is becoming a tool for use in many monitoring programs around the world. Although deep learning accuracy for coral reef classification has been well published for studies where validation metrics are generated from data within surveys, little research has been done on the transferability and generalisability of deep learned models to data never seen by the trained model. Examples include data across multiple capture methods, camera systems, habitat types, water quality conditions and temporal studies. In this paper we investigate the use of deep ensembling to measure the reliability of predictions in new or unseen environments. In this paper we show that ensemble methods are more stable in their calibration across dataset shifts compared with other approaches. Ensembles show more robust uncertainty quantification in unseen environments compared to alternative methods, thus providing more confidence in the use of pre‐trained models in unconstrained environments. These results show that ensembles should be the de facto standard for any practitioner using deep learning for benthic image automation, and applying deep learning approaches to coral classification.Keywords
Funding Information
- Department of Foreign Affairs and Trade, Australian Government (#75334)
- Australian Institute of Marine Science
- Department of Foreign Affairs and Trade, Australian Government
This publication has 44 references indexed in Scilit:
- Towards Automated Annotation of Benthic Survey Images: Variability of Human Experts and Operational Modes of AutomationPLOS ONE, 2015
- ImageNet Large Scale Visual Recognition ChallengeInternational Journal of Computer Vision, 2015
- Ensemble Methods in Data Mining: Improving Accuracy Through Combining PredictionsSynthesis Lectures on Data Mining and Knowledge Discovery, 2010
- Ensemble-based classifiersArtificial Intelligence Review, 2009
- Modelling distribution of marine benthos from hydroacoustics and underwater videoContinental Shelf Research, 2008
- Predicting good probabilities with supervised learning2005
- Ensemble Methods in Machine Learning2000
- Gradient-based learning applied to document recognitionProceedings of the IEEE, 1998
- Safe AI—is this possible?Engineering Applications of Artificial Intelligence, 1995
- VERIFICATION OF FORECASTS EXPRESSED IN TERMS OF PROBABILITYMonthly Weather Review, 1950