Underwater Depth Estimation via Stereo Adaptation Networks
- 27 February 2023
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Circuits and Systems for Video Technology
- Vol. 33 (9) , 5089-5101
Abstract
With the fast development and wide application of stereo depth estimation, adequate high-quality stereo training data with groundtruth depth information plays an important role, but is not easily acquired in underwater environments. Therefore, satisfactory performance of depth estimation is difficult to achieve in underwater environments. In addition, the domain gap also leads to the failure of directly applying existing models of terrestrial scene to underwater scene. Therefore, this paper proposes a novel underwater depth estimation network which can infer depth maps from real underwater stereo images in an adaptation manner. The proposed learning pipeline mainly contains three different adaptation modules, i.e., style adaptation, semantic adaptation and disparity range adaptation, to progressively adapt a terrestrial depth estimation model to the underwater domain. Specifically, due to the lack of underwater training data, we first propose a depth-aware stereo image translation network to synthesize stylized underwater stereo images from terrestrial dataset, thus benefiting the effective training of depth estimation network. Then, considering the weak generalization to the real underwater data when only trained on the above synthetic data, we present a self-ensembling semantic adaptation for depth estimation network to minimize the semantic domain discrepancy between synthetic and real underwater data. Meanwhile, we design a disparity range adaptation module to address the problem of disparity range miss-match between both data, thus obtaining more accurate depth predictions for large-disparity-span underwater images. Experimental results show that by integrating the proposed adaptation modules into the off-the-shelf depth estimation backbones, our method successfully achieves superior performance of underwater depth estimation compared to other state-of-the-art methods.Keywords
Funding Information
- National Natural Science Foundation of China (62027826, 61976038, 61976037)
- Dalian High-level Talents Innovation Support Plan (2021RQ052)
This publication has 41 references indexed in Scilit:
- What is the Space of Attenuation Coefficients in Underwater Computer Vision?2017
- Underwater image dehaze using scene depth estimation with adaptive color correction2017
- A depth estimation model from a single underwater image with non-uniform illumination correction2017
- Experimental research of distance estimation accuracy using underwater acoustic modems to provide navigation of underwater objects2017
- High-Resolution Underwater Robotic Vision-Based Mapping and Three-Dimensional Reconstruction for ArchaeologyJournal of Field Robotics, 2016
- A Large Dataset to Train Convolutional Networks for Disparity, Optical Flow, and Scene Flow Estimation2016
- Cluster-based loop closing detection for underwater slam in feature-poor regions2016
- Underwater 3D capture using a low-cost commercial depth camera2016
- Underwater Depth Estimation and Image Restoration Based on Single ImagesIEEE Computer Graphics and Applications, 2016
- Single underwater image enhancement using depth estimation based on blurriness2015