Robust Forward-Looking Sonar-Image Mosaicking Without External Sensors for Autonomous Deep-Sea Mining
Open Access
- 30 June 2025
- journal article
- research article
- Published by MDPI AG in Journal of Marine Science and Engineering
- Vol. 13 (7) , 1291
Abstract
With the increasing significance of deep-sea resource development, Forward-Looking Sonar (FLS) has become an essential technology for real-time environmental mapping and navigation in deep-sea mining vehicles (DSMV). However, FLS images often suffer from a limited field of view, uneven imaging, and complex noise sources, making single-frame images insufficient for providing continuous and complete environmental awareness. Existing mosaicking methods typically rely on external sensors or controlled laboratory conditions, often failing to account for the high levels of uncertainty and error inherent in real deep-sea environments. Consequently, their performance during sea trials tends to be unsatisfactory. To address these challenges, this study introduces a robust FLS image mosaicking framework that functions without additional sensor input. The framework explicitly models the noise characteristics of sonar images captured in deep-sea environments and integrates bidirectional cyclic consistency filtering with a soft-weighted feature refinement strategy during the feature-matching stage. For image fusion, a radial adaptive fusion algorithm with a protective frame is proposed to improve edge transitions and preserve structural consistency in the resulting panoramic image. The experimental results demonstrate that the proposed framework achieves high robustness and accuracy under real deep-sea conditions, effectively supporting DSMV tasks such as path planning, obstacle avoidance, and simultaneous localization and mapping (SLAM), thus enabling reliable perceptual capabilities for intelligent underwater operations.Keywords
Funding Information
- Shanghai Innovation Action Plan of Science and Technology (19DZ1207300, BH3230001)
- Major Projects of Strategic Emerging Industries in Shanghai (19DZ1207300, BH3230001)
This publication has 30 references indexed in Scilit:
- DSM-Net: A multi-scale detection network of sonar images for deep-sea mining vehicleApplied Ocean Research, 2025
- Adaptive bi-level path optimization for deep-sea mining vehicle in non-uniform grids considering ocean currents and dynamic obstaclesOcean Engineering, 2024
- High-traversability and efficient path optimization for deep-sea mining vehicles considering complex seabed environmental factorsOcean Engineering, 2024
- Underwater Gas Leakage Flow Detection and Classification Based on Multibeam Forward-Looking SonarJournal of Marine Science and Application, 2024
- UP‐GAN: Channel‐spatial attention‐based progressive generative adversarial network for underwater image enhancementJournal of Field Robotics, 2024
- Seabed mapping for deep-sea mining vehicles based on forward-looking sonarOcean Engineering, 2024
- A blending method for forward-looking sonar mosaicing handling intra- and inter-frame artifactsOcean Engineering, 2024
- A brief review of recent progress on deep sea mining vehicleOcean Engineering, 2021
- Forward looking sonar mosaicing for Mine CountermeasuresAnnual Reviews in Control, 2015
- Fourier‐based Registration for Robust Forward‐looking Sonar Mosaicing in Low‐visibility Underwater EnvironmentsJournal of Field Robotics, 2014