A Fully Convolutional Two-Stream Fusion Network for Interactive Image Segmentation
Preprint
Abstract
In this paper, we propose a novel fully convolutional two-stream fusion network (FCTSFN) for interactive image segmentation. The proposed network includes two sub-networks: a two-stream late fusion network (TSLFN) that predicts the foreground at a reduced resolution, and a multi-scale refining network (MSRN) that refines the foreground at full resolution. The TSLFN includes two distinct deep streams followed by a fusion network. The intuition is that, since user interactions are more direct information on foreground/background than the image itself, the two-stream structure of the TSLFN reduces the number of layers between the pure user interaction features and the network output, allowing the user interactions to have a more direct impact on the segmentation result. The MSRN fuses the features from different layers of TSLFN with different scales, in order to seek the local to global information on the foreground to refine the segmentation result at full resolution. We conduct comprehensive experiments on four benchmark datasets. The results show that the proposed network achieves competitive performance compared to current state-of-the-art interactive image segmentation methodsKeywords
All Related Versions
This publication has 10 references indexed in Scilit:
- DeepIGeoS: A Deep Interactive Geodesic Framework for Medical Image SegmentationIEEE Transactions on Pattern Analysis and Machine Intelligence, 2018
- Deep Interactive Region Segmentation and Captioning2017
- DeepLab: Semantic Image Segmentation with Deep Convolutional Nets, Atrous Convolution, and Fully Connected CRFsIEEE Transactions on Pattern Analysis and Machine Intelligence, 2017
- Deep GrabCut for Object Selection2017
- Fully Convolutional Networks for Semantic SegmentationIEEE Transactions on Pattern Analysis and Machine Intelligence, 2016
- A comparative evaluation of interactive segmentation algorithmsPattern Recognition, 2010
- The Pascal Visual Object Classes (VOC) ChallengeInternational Journal of Computer Vision, 2009
- Random Walks for Image SegmentationIEEE Transactions on Pattern Analysis and Machine Intelligence, 2006
- How Iris Recognition WorksIEEE Transactions on Circuits and Systems for Video Technology, 2004
- Fast approximate energy minimization via graph cutsIEEE Transactions on Pattern Analysis and Machine Intelligence, 2001