Side-Scan Sonar Image Classification With Zero-Shot and Style Transfer
- 12 January 2024
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Instrumentation and Measurement
- Vol. 73 (00189456) , 1-15
Abstract
Side-scan sonar (SSS) has become an important tool for ocean exploration due to its practicality and reliability. Existing approaches for SSS image classification mainly rely on deep convolutional neural networks (DCNNs). Although effective, DCNN-based methods fail to classify SSS images with specific target samples that are completely absent from the training data. In this work, a global context external-attention network (GCEANet) is proposed to produce pseudo-SSS images corresponding to the absent categories for zero-shot SSS image classification. First, the optical and acoustic images are taken as content and style image inputs to the network, respectively. Second, a global context (GC) block is proposed to extract the context semantics of the style features and fuse them with the content features. Finally, an external attention (EA) block is proposed to extract the potential correlation between content and style features to generate pseudo-SSS images with optical content. In addition, a contrastive loss based on image reconstruction is proposed to optimize the cross-modal feature space fusion. Extensive experiments demonstrate the effectiveness of our approach in efficiently generating realistic pseudo-SSS samples. The experimental results on real SSS sample datasets show that our method outperforms other state-of-the-art (SOTA) methods in the field of zero-shot SSS image classification. The code is available at https://github.com/baizhongyu/GCEANet.Keywords
Funding Information
- National Natural Science Foundation of China (62203099)
- National Defense Preliminary Research Project (50911020604)
- Fundamental Research Funds for the Central Universities (N2126006, N2326004)
This publication has 42 references indexed in Scilit:
- Bilinear Pooling With Poisoning Detection Module for Automatic Side Scan Sonar Data AnalysisIEEE Access, 2023
- Foreground enhancement network for object detection in sonar imagesMachine Vision and Applications, 2023
- Side scan sonar image augmentation for sediment classification using deep learning based transfer learning approachMaterials Today: Proceedings, 2023
- Zero shot objects classification method of side scan sonar image based on synthesis of pseudo samplesApplied Acoustics, 2021
- Machine Learning Techniques for AUV Side-Scan Sonar Data Feature Extraction as Applied to Intelligent Search for Underwater Archaeological Sites2021
- Noise reduction for sonar images by statistical analysis and fields of expertsJournal of Visual Communication and Image Representation, 2021
- Underwater Object Classification in Sidescan Sonar Images Using Deep Transfer Learning and Semisynthetic Training DataIEEE Access, 2020
- Underwater sonar image classification using adaptive weights convolutional neural networkApplied Acoustics, 2019
- Side scan sonar: A cost-efficient alternative method for measuring seagrass cover in shallow environmentsEstuarine, Coastal and Shelf Science, 2018
- Microsoft COCO: Common Objects in Context2014