Automated plankton image analysis using convolutional neural networks
Authors:
Open Access
- 13 October 2018
- journal article
- research article
- Published by Wiley in Limnology and Oceanography: Methods
- Vol. 16 (12) , 814-827
Abstract
The rise of in situ plankton imaging systems, particularly high‐volume imagers such as the In Situ Ichthyoplankton Imaging System, has increased the need for fast processing and accurate classification tools that can identify a high diversity of organisms and nonliving particles of biological origin. Previous methods for automated classification have yielded moderate results that either can resolve few groups at high accuracy or many groups at relatively low accuracy. However, with the advent of new deep learning tools such as convolutional neural networks (CNNs), the automated identification of plankton images can be vastly improved. Here, we describe an image processing procedure that includes preprocessing, segmentation, classification, and postprocessing for the accurate identification of 108 classes of plankton using spatially sparse CNNs. Following a filtering process to remove images with low classification scores, a fully random evaluation of the classification showed that average precision was 84% and recall was 40% for all groups. Reliably classifying rare biological classes was difficult, so after excluding the 12 rarest taxa, classification accuracy for the remaining biological groups became > 90%. This method provides proof of concept for the effectiveness of an automated classification scheme using deep‐learning methods, which can be applied to a range of plankton or biological imaging systems, with the eventual application in a variety of ecological monitoring and fisheries management contexts.Keywords
Funding Information
- Division of Ocean Sciences (1419987)
- National Oceanic and Atmospheric Administration (Contract AB133C‐11‐CQ‐0050)
This publication has 41 references indexed in Scilit:
- Relationships between phytoplankton thin layers and the fine-scale vertical distributions of two trophic levels of zooplanktonJournal of Plankton Research, 2013
- The Underwater Vision Profiler 5: An advanced instrument for high spatial resolution studies of particle size spectra and zooplanktonLimnology and Oceanography: Methods, 2010
- In situ ichthyoplankton imaging system (ISIIS): system design and preliminary resultsLimnology and Oceanography: Methods, 2008
- Accurate automatic quantification of taxa-specific plankton abundance using dual classification with correctionMarine Ecology Progress Series, 2006
- Automatic plankton image recognition with co-occurrence matrices and Support Vector MachineMarine Ecology Progress Series, 2005
- Real-time observation of taxa-specific plankton distributions: an optical sampling methodMarine Ecology Progress Series, 2004
- A system for high-resolution zooplankton imagingIEEE Journal of Oceanic Engineering, 2001
- Distribution of plankton, particles, and hydrographic features across Georges Bank described using the Video Plankton RecorderDeep Sea Research Part II: Topical Studies in Oceanography, 2001
- Face recognition: a convolutional neural-network approachIEEE Transactions on Neural Networks, 1997
- Automatic classification of field-collected dinoflagellates by artificial neural networkMarine Ecology Progress Series, 1996