Semantic Segmentation in Underwater Ship Inspections: Benchmark and Data Set
Open Access
- 23 December 2022
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Journal of Oceanic Engineering
- Vol. 48 (2) , 462-473
Abstract
In this article, we present the first large-scale data set for underwater ship lifecycle inspection, analysis and condition information (LIACI). It contains 1893 images with pixel annotations for ten object categories: defects, corrosion, paint peel, marine growth, sea chest gratings, overboard valves, propeller, anodes, bilge keel and ship hull. The images have been collected during underwater ship inspections and annotated by human domain experts. We also present a benchmark evaluation of state-of-the-art semantic segmentation approaches based on standard performance metrics. Consequently, we propose to use U-Net with a MobileNetV2 backbone for the segmentation task due to its balanced tradeoff between performance and computational efficiency, which is essential if used for real-time evaluation. Also, we demonstrate its benefits for in-water inspections by providing quantitative evaluations of the inspection findings. With a variety of use cases, the proposed segmentation pipeline and the LIACI data set create new promising opportunities for future research in underwater ship inspections.Keywords
This publication has 27 references indexed in Scilit:
- A novel approach for defect detection on vessel structures using saliency-related featuresOcean Engineering, 2018
- Intelligent Image Recognition System for Marine Fouling Using Softmax Transfer Learning and Deep Convolutional Neural NetworksComplexity, 2017
- Scene Parsing through ADE20K Dataset2017
- Pyramid Scene Parsing Network2017
- An underwater lighting and turbidity image repository for analysing the performance of image-based non-destructive techniquesStructure and Infrastructure Engineering, 2017
- SegNet: A Deep Convolutional Encoder-Decoder Architecture for Image SegmentationIEEE Transactions on Pattern Analysis and Machine Intelligence, 2017
- Deep Residual Learning for Image Recognition2016
- U-Net: Convolutional Networks for Biomedical Image Segmentation2015
- Fully convolutional networks for semantic segmentation2015
- The Pascal Visual Object Classes (VOC) ChallengeInternational Journal of Computer Vision, 2009