Learning to segment under various forms of weak supervision
Authors:
- 1 June 2015
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- No. 10636919,p. 3781-3790
Abstract
Despite the promising performance of conventional fully supervised algorithms, semantic segmentation has remained an important, yet challenging task. Due to the limited availability of complete annotations, it is of great interest to design solutions for semantic segmentation that take into account weakly labeled data, which is readily available at a much larger scale. Contrasting the common theme to develop a different algorithm for each type of weak annotation, in this work, we propose a unified approach that incorporates various forms of weak supervision - image level tags, bounding boxes, and partial labels - to produce a pixel-wise labeling. We conduct a rigorous evaluation on the challenging Siftflow dataset for various weakly labeled settings, and show that our approach outperforms the state-of-the-art by 12% on per-class accuracy, while maintaining comparable per-pixel accuracy.Keywords
This publication has 29 references indexed in Scilit:
- Scene Parsing with Object Instances and Occlusion Ordering2014
- Rich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation2014
- ImageNet Auto-Annotation with Segmentation PropagationInternational Journal of Computer Vision, 2014
- Nonparametric Scene Parsing with Adaptive Feature Relevance and Semantic Context2013
- SuperparsingInternational Journal of Computer Vision, 2012
- Weakly supervised semantic segmentation with a multi-image model2011
- Geodesic star convexity for interactive image segmentation2010
- Minimal Surfaces Extend Shortest Path Segmentation Methods to 3DIEEE Transactions on Pattern Analysis and Machine Intelligence, 2008
- Semantic texton forests for image categorization and segmentation2008
- Random Walks for Image SegmentationIEEE Transactions on Pattern Analysis and Machine Intelligence, 2006