Cross-Modal Adaptive Interaction Network for RGB-D Saliency Detection
Open Access
- 23 August 2024
- journal article
- research article
- Published by MDPI AG in Applied Sciences
- Vol. 14 (17) , 7440
Abstract
The salient object detection (SOD) task aims to automatically detect the most prominent areas observed by the human eye in an image. Since RGB images and depth images contain different information, how to effectively integrate cross-modal features in the RGB-D SOD task remains a major challenge. Therefore, this paper proposes a cross-modal adaptive interaction network (CMANet) for the RGB-D salient object detection task, which consists of a cross-modal feature integration module (CMF) and an adaptive feature fusion module (AFFM). These modules are designed to integrate and enhance multi-scale features from both modalities, improve the effect of integrating cross-modal complementary information of RGB and depth images, enhance feature information, and generate richer and more representative feature maps. Extensive experiments were conducted on four RGB-D datasets to verify the effectiveness of CMANet. Compared with 17 RGB-D SOD methods, our model accurately detects salient regions in images and achieves state-of-the-art performance across four evaluation metrics.Keywords
Funding Information
- Department of Science and Technology of Jilin Province (2022JB405L05)
This publication has 53 references indexed in Scilit:
- Where is my attention? An explainable AI exploration in water detection from SAR imageryInternational Journal of Applied Earth Observation and Geoinformation, 2024
- RCNet: Related Context-Driven Network with Hierarchical Attention for Salient Object DetectionExpert Systems with Applications, 2023
- Specificity-preserving RGB-D saliency detectionComputational Visual Media, 2023
- EGA-Net: Edge feature enhancement and global information attention network for RGB-D salient object detectionInformation Sciences, 2023
- SPSN: Superpixel Prototype Sampling Network for RGB-D Salient Object Detection2022
- Local to Global Feature Learning for Salient Object DetectionPattern Recognition Letters, 2022
- CFIDNet: cascaded feature interaction decoder for RGB-D salient object detectionNeural Computing and Applications, 2022
- CNN-based encoder-decoder networks for salient object detection: A comprehensive review and recent advancesInformation Sciences, 2021
- ImageNet Large Scale Visual Recognition ChallengeInternational Journal of Computer Vision, 2015
- RGBD Salient Object Detection: A Benchmark and Algorithms2014