CAPDepth: 360 Monocular Depth Estimation by Content-Aware Projection

Authors:
Open Access
Publisher website
Google Scholar
Abstract
Solving the depth estimation problem in a 360° image space, which has holistic scene perception, has become a trend in recent years. However, depth estimation in common 360° images is prone to geometric distortion. Therefore, this study proposes a new method, CAPDepth, to address the geometric-distortion problem of 360° monocular depth estimation. We reduce the tangential projections by an optimized content-aware projection (CAP) and a geometric embedding module to capture more features for global depth consistency. Additionally, we adopt an index map and a de-blocking scheme to improve the inference efficiency and quality of our CAPDepth model. Our experiments show that CAPDepth greatly alleviates the distortion problem, producing smoother, more accurate predicted depth results, and improves performance in panoramic depth estimation.
Funding Information
  • Zhengzhou Major Science and Technology Project (2021KJZX0060, 24B413010, 221100210600)
  • Key Scientific Research Projects of Colleges and Universities in Henan Province (2021KJZX0060, 24B413010, 221100210600)
  • Technology Special Projects in Henan Province (2021KJZX0060, 24B413010, 221100210600)

This publication has 34 references indexed in Scilit: