Progressive Semantic Segmentation
Authors:
- 1 June 2021
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 16750-16759
Abstract
The objective of this work is to segment high-resolution images without overloading GPU memory usage or losing the fine details in the output segmentation map. The memory constraint means that we must either downsample the big image or divide the image into local patches for separate processing. However, the former approach would lose the fine details, while the latter can be ambiguous due to the lack of a global picture. In this work, we present MagNet, a multi-scale framework that resolves local ambiguity by looking at the image at multiple magnification levels. MagNet has multiple processing stages, where each stage corresponds to a magnification level, and the output of one stage is fed into the next stage for coarse-to-fine information propagation. Each stage analyzes the image at a higher resolution than the previous stage, recovering the previously lost details due to the lossy downsampling step, and the segmentation output is progressively refined through the processing stages. Experiments on three high-resolution datasets of urban views, aerial scenes, and medical images show that MagNet consistently outperforms the state-of-the-art methods by a significant margin. Code is available at https://github.com/VinAIResearch/MagNet.Keywords
All Related Versions
This publication has 26 references indexed in Scilit:
- Pyramid Scene Parsing Network2017
- DeepLab: Semantic Image Segmentation with Deep Convolutional Nets, Atrous Convolution, and Fully Connected CRFsIEEE Transactions on Pattern Analysis and Machine Intelligence, 2017
- SegNet: A Deep Convolutional Encoder-Decoder Architecture for Image SegmentationIEEE Transactions on Pattern Analysis and Machine Intelligence, 2017
- Zoom Better to See Clearer: Human and Object Parsing with Hierarchical Auto-Zoom Net2016
- The Cityscapes Dataset for Semantic Urban Scene Understanding2016
- Iterative Instance Segmentation2016
- Attention to Scale: Scale-Aware Semantic Image Segmentation2016
- Fully convolutional networks for semantic segmentation2015
- The Role of Context for Object Detection and Semantic Segmentation in the Wild2014
- EyePACS: An Adaptable Telemedicine System for Diabetic Retinopathy ScreeningJournal of Diabetes Science and Technology, 2009