ConnNet: A Long-Range Relation-Aware Pixel-Connectivity Network for Salient Segmentation
- 14 December 2018
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Image Processing
- Vol. 28 (5) , 2518-2529
Abstract
Salient segmentation aims to segment out attentiongrabbing regions, a critical yet challenging task and the foundation of many high-level computer vision applications. It requires semantic-aware grouping of pixels into salient regions and benefits from the utilization of global multi-scale contexts to achieve good local reasoning. Previous works often address it as two-class segmentation problems utilizing complicated multi-step procedures including refinement networks and complex graphical models. We argue that semantic salient segmentation can instead be effectively resolved by reformulating it as a simple yet intuitive pixel-pair based connectivity prediction task. Following the intuition that salient objects can be naturally grouped via semanticaware connectivity between neighboring pixels, we propose a pure Connectivity Net (ConnNet). ConnNet predicts connectivity probabilities of each pixel with its neighboring pixels by leveraging multi-level cascade contexts embedded in the image and long-range pixel relations. We investigate our approach on two tasks, namely salient object segmentation and salient instancelevel segmentation, and illustrate that consistent improvements can be obtained by modeling these tasks as connectivity instead of binary segmentation tasks for a variety of network architectures. We achieve state-of-the-art performance, outperforming or being comparable to existing approaches while reducing inference time due to our less complex approach.Keywords
All Related Versions
Funding Information
- Norges Forskningsråd (239844)
This publication has 37 references indexed in Scilit:
- Fast R-CNN2015
- Holistically-Nested Edge Detection2015
- Deep networks for saliency detection via local estimation and global search2015
- Saliency detection by multi-context deep learning2015
- Fully convolutional networks for semantic segmentation2015
- Global Contrast Based Salient Region DetectionIEEE Transactions on Pattern Analysis and Machine Intelligence, 2014
- Hierarchical Saliency Detection2013
- Saliency filters: Contrast based filtering for salient region detection2012
- An Integrated Model of Top-Down and Bottom-Up Attention for Optimizing Detection Speed2006
- A user attention model for video summarization2002