DepthMaster: Taming Diffusion Models for Monocular Depth Estimation
Top Cited Papers
- 6 April 2026
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Circuits and Systems for Video Technology
- Vol. PP (10518215) , 1
Abstract
Monocular depth estimation within the denoising diffusion paradigm demonstrates impressive generalization ability but suffers from low inference speed. Recent methods adopt a single-step deterministic paradigm to improve inference efficiency. However, uncritically applying the generative features from diffusion models to the perceptual depth estimation task leads to suboptimal results, due to the differences between image generation and dense prediction. In this work, we propose Depth-Master, a single-step diffusion model designed to tame diffusion models for enhanced performance and visual quality. First, to mitigate overfitting to texture details introduced by generative features, we propose a Feature Alignment module, which incorporates high-quality semantic features to enhance the denoising network’s representation capability. Second, to address the lack of fine-grained details in the single-step deterministic framework, we propose a Fourier Enhancement module to adaptively balance low-frequency structure and high-frequency details. We adopt a two-stage training strategy to fully leverage the potential of the two modules. In the first stage, we focus on learning the global scene structure with the Feature Alignment module, while in the second stage, we exploit the Fourier Enhancement module to improve the visual quality. Through these efforts, our model achieves state-of-the-art performance in terms of generalization and detail preservation, outperforming other diffusion-based methods across various datasets. Our project page can be found at https://indu1ge.github.io/DepthMaster page.Keywords
All Related Versions
Funding Information
- National Natural Science Foundation of China (62394354)
- Youth Innovation Promotion Association of the Chinese Academy of Sciences
This publication has 61 references indexed in Scilit:
- DiffusionDepth: Diffusion Denoising Approach for Monocular Depth Estimation2024
- Diffusion Models for Monocular Depth Estimation: Overcoming Challenging Conditions2024
- GeoWizard: Unleashing the Diffusion Priors for 3D Geometry Estimation from a Single Image2024
- LocalBins: Improving Depth Estimation by Learning Local Distributions2022
- Web Stereo Video Supervision for Depth Prediction from Dynamic Scenes2019
- A Multi-view Stereo Benchmark with High-Resolution Images and Multi-camera Videos2017
- ScanNet: Richly-Annotated 3D Reconstructions of Indoor Scenes2017
- Deeper Depth Prediction with Fully Convolutional Residual Networks2016
- Indoor Segmentation and Support Inference from RGBD Images2012
- Robust Estimation of a Location Parameter1992