Objectness-Aware One-Shot Semantic Segmentation
Authors:
Preprint
Abstract
While deep convolutional neural networks have led to great progress in image semantic segmentation, they typically require collecting a large number of densely-annotated images for training. Moreover, once trained, the model can only make predictions in a pre-defined set of categories. Therefore, few-shot image semantic segmentation has been explored to learn to segment from only a few annotated examples. In this paper, we tackle the challenging one-shot semantic segmentation problem by taking advantage of objectness. In order to capture prior knowledge of object and background, we first train an objectness segmentation module which generalizes well to unseen categories. Then we use the objectness module to predict the objects present in the query image, and train an objectness-aware few-shot segmentation model that takes advantage of both the object information and limited annotations of the unseen category to perform segmentation in the query image. Our method achieves a mIoU score of 57.9% and 22.6% given only one annotated example of an unseen category in PASCAL-5i and COCO-20i, outperforming related baselines overall.Keywords
All Related Versions
This publication has 8 references indexed in Scilit:
- SG-One: Similarity Guidance Network for One-Shot Semantic SegmentationIEEE Transactions on Cybernetics, 2020
- Differentiable Meta-Learning Model for Few-Shot Semantic SegmentationProceedings of the AAAI Conference on Artificial Intelligence, 2020
- Pixel Objectness: Learning to Segment Generic Objects Automatically in Images and VideosIEEE Transactions on Pattern Analysis and Machine Intelligence, 2018
- The Pascal Visual Object Classes Challenge: A RetrospectiveInternational Journal of Computer Vision, 2014
- Microsoft COCO: Common Objects in Context2014
- Geodesic Object Proposals2014
- CPMC: Automatic Object Segmentation Using Constrained Parametric Min-CutsIEEE Transactions on Pattern Analysis and Machine Intelligence, 2011
- TextonBoost for Image Understanding: Multi-Class Object Recognition and Segmentation by Jointly Modeling Texture, Layout, and ContextInternational Journal of Computer Vision, 2007