Embedding Attention and Residual Network for Accurate Salient Object Detection
- 27 November 2018
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Cybernetics
- Vol. 50 (5) , 2050-2062
Abstract
Salient object detection is usually used as a preprocessing step to facilitate a variety of subsequent applications which should take little time cost. With the quick development of deep learning recently, profound progresses have been made to achieve a new state-of-the-art performance. However, the learned features of the existing deep learning-based methods are not accurate enough thus leading to unsatisfactory detection in complex scenes, such as low contrast or very similar between salient object and background region and multiple (small) salient objects with diverse characteristics. In addition, some post-processing techniques are usually needed for refinement, which is time consuming. To address these issues, this paper presents an efficient fully convolutional salient object detection network. Specifically, we first introduce a visual attention mechanism to guide feature learning in side output layers. In detail, attention weight is employed in a top-down manner which can bridge high level semantic information to help shallow layers better locate salient objects and also filter out noisy response in the background region. Second, we propose a residual refinement network to fuse the learned multilevel features gradually. Not to simply add or concatenate them step by step as previous works, we introduce a second-order term into element-wise addition to learn stage-wise residual features for refinement. Such a second-order term not only benefits efficient gradient propagation but also increases network nonlinearity. Extensive experiments on seven standard benchmarks demonstrate that the proposed approach achieves consistently superior performance and performs well on small salient object detection in comparison with the very recent state-of-the-arts, especially in the metric of structure-measure.Keywords
Funding Information
- National Natural Science Foundation of China (61802336)
- Jiangsu Province 7th Projects for Summit Talents in Six Main Industries
- Electronic Information Industry (DZXX-149, No.110)
- Foundation of Yangzhou University (2017CXJ026)
This publication has 59 references indexed in Scilit:
- Object-level saliency detection with color attributesPattern Recognition, 2016
- Salient Object Detection: A BenchmarkIEEE Transactions on Image Processing, 2015
- The Application of Visual Saliency Models in Objective Image Quality Assessment: A Statistical EvaluationIEEE Transactions on Neural Networks and Learning Systems, 2015
- Hierarchical Image Saliency Detection on Extended CSSDIEEE Transactions on Pattern Analysis and Machine Intelligence, 2015
- Fully convolutional networks for semantic segmentation2015
- Caffe2014
- Unsupervised Object Class Discovery via Saliency-Guided Multiple Class LearningIEEE Transactions on Pattern Analysis and Machine Intelligence, 2014
- Global Contrast Based Salient Region DetectionIEEE Transactions on Pattern Analysis and Machine Intelligence, 2014
- Saliency Detection via Graph-Based Manifold Ranking2013
- A database of human segmented natural images and its application to evaluating segmentation algorithms and measuring ecological statistics2002