Enhancing Inter-AUV Perception: Adaptive 6-DOF Pose Estimation with Synthetic Images for AUV Swarm Sensing
Open Access
Abstract
The capabilities of AUV mutual perception and localization are crucial for the development of AUV swarm systems. We propose the AUV6D model, a synthetic image-based approach to enhance inter-AUV perception through 6D pose estimation. Due to the challenge of acquiring accurate 6D pose data, a dataset of simulated underwater images with precise pose labels was generated using Unity3D. Mask-CycleGAN technology was introduced to transform these simulated images into realistic synthetic images, addressing the scarcity of available underwater data. Furthermore, the Color Intermediate Domain Mapping strategy is proposed to ensure alignment across different image styles at pixel and feature levels, enhancing the adaptability of the pose estimation model. Additionally, the Salient Keypoint Vector Voting Mechanism was developed to improve the accuracy and robustness of underwater pose estimation, enabling precise localization even in the presence of occlusions. The experimental results demonstrated that our AUV6D model achieved millimeter-level localization precision and pose estimation errors within five degrees, showing exceptional performance in complex underwater environments. Navigation experiments with two AUVs further verified the model’s reliability for mutual 6D pose estimation. This research provides substantial technical support for more complex and precise collaborative operations for AUV swarms in the future.Keywords
Funding Information
- Strategic Priority Research Program of the Chinese Academy of Sciences (XDC 03060201)
This publication has 35 references indexed in Scilit:
- Underwater object detection and datasets: a surveyIntelligent Marine Technology and Systems, 2024
- ROV6D: 6D Pose Estimation Benchmark Dataset for Underwater Remotely Operated VehiclesIEEE Robotics and Automation Letters, 2023
- Acoustic communication and imaging sonar guided AUV docking: system infrastructure, docking methodology and lake trialsControl Engineering Practice, 2023
- Underwater Image Enhancement Method via Multi-Interval Subhistogram Perspective EqualizationIEEE Journal of Oceanic Engineering, 2023
- A systematic review and analysis of deep learning-based underwater object detectionNeurocomputing, 2023
- Double U-Net CycleGAN for 3D MR to CT image synthesisInternational Journal of Computer Assisted Radiology and Surgery, 2022
- Underwater scene prior inspired deep underwater image and video enhancementPattern Recognition, 2020
- WaterGAN: Unsupervised Generative Network to Enable Real-time Color Correction of Monocular Underwater ImagesIEEE Robotics and Automation Letters, 2017
- Cooperative navigation of AUVs via acoustic communication networking: field experience with the Typhoon vehiclesAutonomous Robots, 2016
- Image quality assessment: from error visibility to structural similarityIEEE Transactions on Image Processing, 2004