TCRNet: A Trifurcated Cascaded Refinement Network for Salient Object Detection
- 18 August 2022
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Circuits and Systems for Video Technology
- Vol. 33 (1) , 298-311
Abstract
Due to the rapid development of deep learning, salient object detection has achieved promising results in recent years. However, how to construct a powerful saliency detection network to generate saliency maps with completely highlighted salient objects and effectively suppressed background noise still remains an open and challenging problem. In this paper, we propose a novel trifurcated cascaded refinement network (TCRNet) to explore multi-level feature fusion and global information representation. Specifically, all the side-output features from the backbone network are divided into three branches (i.e., global information, deep information and shallow information) according to feature similarities, and then the global contexts, semantic knowledge and fined details respectively generated by the three branches are integrated in a cascaded refinement way. This refinement strategy aims to guide the feature learning of important regions and suppress background noises. Moreover, we propose a cross-level feature fusion (CFF) module to fuse multi-level similar features within a same branch by exploring their interrelationship, thus capturing the important semantic information and structure details. To this end, the complementarity of similar features is utilized to refine feature at each level by sharing an encoded spatial weight map. Besides, we design a context-aware feature learning (CFL) module to capture global contexts in a single layer by taking account of both single-feature representation and multi-feature interaction, thus providing important location information of salient objects. Extensive experiments on five benchmarks are conducted to demonstrate that the proposed network TCRNet performs favorably against 20 state-of-the-art salient object detection methods on five benchmark datasets, indicating the effectiveness and superiority of our method.Keywords
Funding Information
- Natural Science Foundation of Shanghai Municipality (19ZR1455300, 21ZR1462600)
This publication has 84 references indexed in Scilit:
- Holistically-Nested Edge Detection2015
- Salient Object Detection: A BenchmarkIEEE Transactions on Image Processing, 2015
- Deep networks for saliency detection via local estimation and global search2015
- Saliency detection by multi-context deep learning2015
- Saliency-aware geodesic video object segmentation2015
- From captions to visual concepts and back2015
- Fully convolutional networks for semantic segmentation2015
- Hierarchical Saliency Detection2013
- Saliency Detection via Graph-Based Manifold Ranking2013
- Saliency filters: Contrast based filtering for salient region detection2012