Biodiversity Image Quality Metadata Augments Convolutional Neural Network Classification of Fish Species
Authors:
- Jeremy LeipzigJLJeremy Leipzig
- Yasin BakisYBYasin Bakis
- Xiaojun WangXWXiaojun Wang
- Mohannad ElhamodMEMohannad Elhamod
- Kelly DiamondKDKelly Diamond
- Wasila DahdulWDWasila Dahdul
- Anuj KarpatneAKAnuj Karpatne
- Murat MagaMMMurat Maga
- Paula MabeePMPaula Mabee
- Henry L. BartHBHenry L. Bart
- Jane GreenbergJGJane Greenberg
- 18 March 2021
- book chapter
- Published by Springer Nature
- Vol. 1355, 3-12
Abstract
Biodiversity image repositories are crucial sources for training machine learning approaches to support biological research. Metadata about object (e.g. image) quality is a putatively important prerequisite to selecting samples for these experiments. This paper reports on a study demonstrating the importance of image quality metadata for a species classification experiment involving a corpus of 1935 fish specimen images which were annotated with 22 metadata quality properties. A small subset of high quality images produced an F1 accuracy of 0.41 compared to 0.35 for a taxonomically matched subset low quality images when used by a convolutional neural network approach to species identification. Using the full corpus of images revealed that image quality differed between correctly classified and misclassified images. We found anatomical feature visibility was the most important quality feature for classification accuracy. We suggest biodiversity image repositories consider adopting a minimal set of image quality metadata to support machine learning.Keywords
This publication has 10 references indexed in Scilit:
- The role of metadata in reproducible computational researchPatterns, 2021
- Schrödinger's phenotypes: Herbarium specimens show two‐dimensional images are both good and (not so) bad sources of morphological dataMethods in Ecology and Evolution, 2020
- Improving Image Classification with Location Context2015
- Automatic identification of species with neural networksPeerJ, 2014
- 3D Slicer: A Platform for Subject-Specific Image Analysis, Visualization, and Clinical Support2013
- Analysis and synthesis of metadata goals for scientific dataJournal of the American Society for Information Science and Technology, 2012
- Torchvision the machine-vision package of torch2010
- Categorization of natural scenes2006
- Understanding Metadata and Metadata SchemesCataloging & Classification Quarterly, 2005
- Introduction to the ACR-NEMA DICOM standard.RadioGraphics, 1992