Endo-DFD: Deep Flow-to-Depth in Endoscopy With Uncertainty-Driven Recurrent Refinement
- 11 December 2025
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Instrumentation and Measurement
- Vol. 74 (00189456) , 1-12
Abstract
Dense depth estimation from monocular video frames provides accurate intraoperative 3D point clouds for augmented reality surgical navigation. However, multi-frame depth estimation within the endoscopic scene suffers from the inaccurate matching of geometric relationships under subtle camera movements. To address this challenge, we propose a novel deep flow-to-depth method with uncertainty-driven recurrent refinement. Specifically, a pixel-wise uncertainty-driven optimizer is proposed to iteratively refine depth predictions instead of the traditional cost volume, effectively reducing depth errors caused by low textures and illumination variations. Furthermore, a two-view geometry with motion simulator is employed to augment the optical flow network’s ability to explore temporal correlations under subtle camera movements. Extensive cross-datasets experiments demonstrate the superior accuracy and generalization of our method, achieving RMSE values of 6.566 on C3VD, 7.972 on EndoSLAM, and 16.697 on ColonDepth datasets. Qualitative evaluation conducted on clinical dataset demonstrates the promising ability of our method to accurately estimate realistic anatomical structures in real-world scenarios. The code will be accessible at the following link: https://github. com/ILSR-SIA/Endo-DFD.Keywords
Funding Information
- National Key Research and Development Program of China (2023YFB4705700)
- National Natural Science Foundation of China (62303450)
- National Natural Science Foundation of China (U20A20195)
- Fundamental Research Project of Shenyang Institute of Automation (2023JC1K06)
- Liaoning Province Science and Technology Project (2024JH2/102400049)
- Liaoning Province Science and Technology Project (2025080132-JH2/1013)
This publication has 42 references indexed in Scilit:
- Variable stiffness methods of flexible robots for minimally invasive surgery: A reviewBiomimetic Intelligence and Robotics, 2024
- A geometry-aware deep network for depth estimation in monocular endoscopyEngineering Applications of Artificial Intelligence, 2023
- Self-Supervised monocular depth and ego-Motion estimation in endoscopy: Appearance flow to the rescueMedical Image Analysis, 2022
- EndoSLAM dataset and an unsupervised monocular visual odometry and depth estimation approach for endoscopic videosMedical Image Analysis, 2021
- Implicit domain adaptation with conditional generative adversarial networks for depth prediction in endoscopyInternational Journal of Computer Assisted Radiology and Surgery, 2019
- MVSNet: Depth Inference for Unstructured Multi-view Stereo2018
- SLAM-based dense surface reconstruction in monocular Minimally Invasive Surgery and its application to Augmented RealityComputer Methods and Programs in Biomedicine, 2018
- What Makes Good Synthetic Training Data for Learning Disparity and Optical Flow Estimation?International Journal of Computer Vision, 2018
- Pixelwise View Selection for Unstructured Multi-View Stereo2016
- Random Sample Consensus: A Paradigm for Model Fitting with Applications to Image Analysis and Automated Cartography1987