A New Aggregation of DNN Sparse and Dense Labeling for Saliency Detection
- 16 January 2020
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Cybernetics
- Vol. 51 (12) , 5907-5920
Abstract
As a fundamental requirement to many computer vision systems, saliency detection has experienced substantial progress in recent years based on deep neural networks (DNNs). Most DNN-based methods rely on either sparse or dense labeling, and thus they are subject to the inherent limitations of the chosen labeling schemes. DNN dense labeling captures salient objects mainly from global features, which are often hampered by other visually distinctive regions. On the other hand, DNN sparse labeling is usually impeded by inaccurate presegmentation of the images that it depends on. To address these limitations, we propose a new framework consisting of two pathways and an Aggregator to progressively integrate the DNN sparse and DNN dense labeling schemes to derive the final saliency map. In our ``zipper'' type aggregation, we propose a multiscale kernels approach to extract optimal criteria for saliency detection where we suppress nonsalient regions in the sparse labeling while guiding the dense labeling to recognize more complete extent of the saliency. We demonstrate that our method outperforms in saliency detection compared to other 11 state-of-the-art methods across six well-recognized benchmarking datasets.Keywords
This publication has 59 references indexed in Scilit:
- ImageNet Large Scale Visual Recognition ChallengeInternational Journal of Computer Vision, 2015
- SuperCNN: A Superpixelwise Convolutional Neural Network for Salient Object DetectionInternational Journal of Computer Vision, 2015
- Action recognition by spatio-temporal oriented energiesInformation Sciences, 2014
- Global Contrast Based Salient Region DetectionIEEE Transactions on Pattern Analysis and Machine Intelligence, 2014
- SalientShape: group saliency in image collectionsThe Visual Computer, 2013
- The central fixation bias in scene viewing: Selecting an optimal viewing position independently of motor biases and image feature distributionsJournal of Vision, 2007
- Seam carving for content-aware image resizingACM Transactions on Graphics, 2007
- AutoCollageACM Transactions on Graphics, 2006
- Does luminance‐contrast contribute to a saliency map for overt visual attention?European Journal of Neuroscience, 2003
- A model of saliency-based visual attention for rapid scene analysisIEEE Transactions on Pattern Analysis and Machine Intelligence, 1998