RGB-D Fusion Through Zero-Shot Fuzzy Membership Learning for Salient Object Detection
- 12 March 2024
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Artificial Intelligence
- Vol. 5 (7) , 3638-3652
Abstract
Significant improvement has been achieved lately in color and depth data based salient object detection on images from varied datasets, which is mainly due to RGB-D 1 1RGB-D represents Color-Depth. fusion using modern machine learning techniques. However, little emphasis has been given recently on performing RGB-D fusion for salient object detection in the absence of ground truth data for training. This paper proposes a zero-shot deep RGB-D fusion approach based on the novel concept of fuzzy membership learning, which does not require any data for training. The constituent salient object maps to be fused are represented using parametric fuzzy membership functions and the optimal parameter values are estimated through our zero-shot fuzzy membership learning (Z-FML) network. The optimal parameter values are used in a fuzzy inference system along with the constituent salient object maps to perform the fusion. A measure called the membership similarity measure (MSM) is proposed, and the Z-FML network is trained using it to devise a loss function that maximizes the similarity between the constituent salient object maps and the fused salient object map. The deduction of MSM and its properties are shown theoretically, and the gradients involved in the training of the Z-FML network are derived. Qualitative and quantitative evaluations using several datasets signify the effectiveness of our RGB-D fusion and our fusion based RGBD salient object detection in comparison to the state-of-the-art. We also empirically demonstrate the advantage of employing the novel MSM for training our Z-FML network.Keywords
This publication has 85 references indexed in Scilit:
- CFIDNet: cascaded feature interaction decoder for RGB-D salient object detectionNeural Computing and Applications, 2022
- Hierarchical Dynamic Filtering Network for RGB-D Salient Object Detection2020
- A Single Stream Network for Robust and Real-Time RGB-D Salient Object Detection2020
- RGB-D Salient Object Detection with Cross-Modality Modulation and Selection2020
- Progressively Guided Alternate Refinement Network for RGB-D Salient Object Detection2020
- BBS-Net: RGB-D Salient Object Detection with a Bifurcated Backbone Strategy Network2020
- RGB-D Face Recognition: A Comparative Study of Representative Fusion Schemes2018
- A Multilayer Backpropagation Saliency Detection Algorithm Based on Depth Mining2017
- RGBD Salient Object Detection: A Benchmark and Algorithms2014
- Model Based Training, Detection and Pose Estimation of Texture-Less 3D Objects in Heavily Cluttered Scenes2013