Abstract
Indoor depth measurement is widely used in technologies such as virtual reality and augmented reality. However, indoor scenes are typically captured with handheld cameras, resulting in more complex and unpredictable variations between frames. Self-supervised depth estimation relies on frame-to-frame projection for self-constraint, and inaccurate pose predictions between frames significantly hinder depth estimation in indoor environments. To address this issue, PRDepth is proposed, a self-supervised pose refinement method tailored for indoor environments. PRDepth introduces a Pose Reconstruction Iterative Module that refines multi-frame pose decomposition and reconstruction. By leveraging contextual information from intermediate frames, it mitigates estimation errors caused by large rotations and reduces training errors due to inaccurate rotations, leading to more precise pose predictions between frames. Additionally, to enhance the information exchange and context integration capabilities of the depth network, PRDepth features a depth-weighted incentive module, which includes a Global Depth Enhancement Module in the encoder-decoder and a Weight-Adaptive Incentive Module in the decoder. The Global Depth Enhancement Module improves the network’s ability to extract depth information in complex scenes by interacting with global cross-dimensional data. An attention-guided mechanism is adopted by the Weight-Adaptive Incentive Module to aggregate multi-scale feature information and assign adaptive weights to different features, ensuring efficient global context fusion and suppression of redundant information. Experimental results demonstrate that our method significantly outperforms existing state-of-the-art self-supervised monocular depth estimation techniques for indoor scenes. Extensive ablation studies are conducted on each module of PRDepth. PRDepth demonstrates precise depth estimation and robust generalization across indoor datasets, including NYUv2, 7-Scenes, ScanNet, and InteriorNet.
Funding Information
  • National Natural Science Foundation of China (52304182, 52204177)
  • Open Fund of the Key Laboratory of System Control and Information Processing of the Ministry of Education of China (SCIP20240105)
  • open fund of the Key Laboratory of Pattern Recognition and Intelligent Information Processing, Institutions of Higher Education of Sichuan Province, Chengdu University (MSSB202404)
  • Open Fund of the Technology Innovation Base for Fine Exploration and Intelligent Monitoring of Mines (2023MPIM03)
  • Future Distinguished Talent Fund of China University of Mining and Technology (2022WLJCRCZL105)