DesNet: Decomposed Scale-Consistent Network for Unsupervised Depth Completion
Open Access
- 26 June 2023
- journal article
- research article
- Published by Association for the Advancement of Artificial Intelligence (AAAI) in Proceedings of the AAAI Conference on Artificial Intelligence
- Vol. 37 (3) , 3109-3117
Abstract
Unsupervised depth completion aims to recover dense depth from the sparse one without using the ground-truth annotation. Although depth measurement obtained from LiDAR is usually sparse, it contains valid and real distance information, i.e., scale-consistent absolute depth values. Meanwhile, scale-agnostic counterparts seek to estimate relative depth and have achieved impressive performance. To leverage both the inherent characteristics, we thus suggest to model scale-consistent depth upon unsupervised scale-agnostic frameworks. Specifically, we propose the decomposed scale-consistent learning (DSCL) strategy, which disintegrates the absolute depth into relative depth prediction and global scale estimation, contributing to individual learning benefits. But unfortunately, most existing unsupervised scale-agnostic frameworks heavily suffer from depth holes due to the extremely sparse depth input and weak supervisory signal. To tackle this issue, we introduce the global depth guidance (GDG) module, which attentively propagates dense depth reference into the sparse target via novel dense-to-sparse attention. Extensive experiments show the superiority of our method on outdoor KITTI, ranking 1st and outperforming the best KBNet more than 12% in RMSE. Additionally, our approach achieves state-of-the-art performance on indoor NYUv2 benchmark as well.Keywords
All Related Versions
This publication has 32 references indexed in Scilit:
- RigNet: Repetitive Image Guided Network for Depth Completion2022
- Multi-modal Masked Pre-training for Monocular Panoramic Depth Completion2022
- Non-local Spatial Propagation Network for Depth Completion2020
- Pseudo RGB-D for Self-improving Monocular SLAM and Depth Prediction2020
- Feature-Metric Loss for Self-supervised Learning of Depth and Egomotion2020
- DeepLiDAR: Deep Surface Normal Guided Depth Prediction for Outdoor Scene From Sparse LiDAR Data and Single Color Image2019
- In Defense of Classical Image Processing: Fast Depth Completion on the CPU2018
- Unsupervised Learning of Depth and Ego-Motion from Video2017
- Monocular Depth Estimation Using Neural Regression Forest2016
- Scale-space properties of the multiscale morphological dilation-erosionIEEE Transactions on Pattern Analysis and Machine Intelligence, 1996