Self-supervised monocular depth estimation based on cross-modal feature interaction and edge optimization
Authors:
- 10 July 2025
- journal article
- Published by IOP Publishing in Measurement Science and Technology
- Vol. 36 (7) , 075410
Abstract
Self-supervised monocular depth estimation has gained significant traction in autonomous driving and robotics owing to its inherent advantages. Recent studies focus on joint semantic and depth information utilization to improve depth estimation precision. This cross-modal fusion represents a promising approach to enhance depth estimation quality. However, achieving effective fusion and interaction between semantic and depth features remains a significant challenge. We propose a novel self-supervised framework integrating cross-modal feature interaction strategy with edge optimization strategy to address this. The proposed architecture comprises two key components: a pose estimation network and a feature interaction network. Within the feature interaction network, we introduce a cross-modal interaction module that enables bidirectional refinement of depth and semantic features; this module facilitates enhanced synergistic integration of multimodal information. Furthermore, we design a semantic-guided edge optimization module that harnesses semantic boundary features to augment depth representations, producing refined edge details. Extensive experiments conducted on the KITTI dataset demonstrate that the proposed model achieves competitive performance in monocular depth estimation, and compared to other state-of-the-art research methods, our approach exhibits superior performance.Keywords
Funding Information
- Science and Technology Program Project of Tianjin (No. 21YFFCYS00080)
This publication has 21 references indexed in Scilit:
- STAMF: Synergistic transformer and mamba fusion network for RGB-Polarization based underwater salient object detectionInformation Fusion, 2025
- MSDFNet: multi-scale detail feature fusion encoder–decoder network for self-supervised monocular thermal image depth estimationMeasurement Science and Technology, 2024
- Graph semantic information for self-supervised monocular depth estimationPattern Recognition, 2024
- Robust and accurate depth estimation by fusing LiDAR and stereoMeasurement Science and Technology, 2023
- PCTNet: depth estimation from single structured light image with a parallel CNN-transformer networkMeasurement Science and Technology, 2023
- Learning depth via leveraging semantics: Self-supervised monocular depth estimation with both implicit and explicit semantic guidancePattern Recognition, 2023
- GCNDepth: Self-supervised monocular depth estimation based on graph convolutional networkNeurocomputing, 2022
- Dense depth estimation from multiple 360-degree images using virtual depthApplied Intelligence, 2022
- Self-supervised monocular depth estimation based on image texture detail enhancementThe Visual Computer, 2021
- SOSD-Net: Joint semantic object segmentation and depth estimation from monocular imagesNeurocomputing, 2021