A Lightweight Multi-Modal Attention Fusion Network for Guided Depth Map Super-Resolution

Authors:
Open Access
Publisher website
Google Scholar
Abstract
Existing guided depth map super-resolution methods have achieved promising results, but most of these methods suffer from large model parameters and high computational complexity, limiting their practical applicability. To address these challenges, this paper proposes a lightweight guided depth map super-resolution framework based on the Multi-Modal Attention Fusion Network (MAFNet). Specifically, we design a two-branch architecture for MAFNet, wherein the Swin branch captures global dependencies and the CNN branch extracts detailed local features, thus ensuring efficient processing. Furthermore, we propose a triple cross-modal attention module for effective fusion of color and depth information, and a compression selectivity bottleneck module to selectively filter essential features. Experimental evaluation on multiple public datasets demonstrates that the proposed MAFNet achieves a compelling balance between model performance and computational efficiency, offering a robust solution for guided depth map super-resolution.
Funding Information
  • National Natural Science Foundation of China (U24A20333, 62472443)
  • Natural Science Foundation of Hunan Province (2024JJ3032)
  • Noncommunicable Chronic Diseases-National Science and Technology Major Project (2023ZD0508200, 2023ZD0508201)
  • Scientific Research Program of FuRong Laboratory (2025PT5009)
  • Xiangjiang Lab Project (25XJ01004)

This publication has 42 references indexed in Scilit: