Generative Semantic Segmentation
Authors:
- 1 June 2023
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 7111-7120
Abstract
We present Generative Semantic Segmentation (GSS), a generative learning approach for semantic segmentation. Uniquely, we cast semantic segmentation as an image-conditioned mask generation problem. This is achieved by replacing the conventional per-pixel discriminative learning with a latent prior learning process. Specifically, we model the variational posterior distribution of latent vari-ables given the segmentation mask. To that end, the segmentation mask is expressed with a special type of image (dubbed as maskige). This posterior distribution allows to generate segmentation masks unconditionally. To achieve semantic segmentation on a given image, we further intro-duce a conditioning network. It is optimized by minimizing the divergence between the posterior distribution of maskige (i.e. segmentation masks) and the latent prior distribution of input training images. Extensive experiments on standard benchmarks show that our GSS can perform competitively to prior art alternatives in the standard semantic segmentation setting, whilst achieving a new state of the art in the more challenging cross-domain setting.Keywords
All Related Versions
Funding Information
- National Natural Science Foundation of China (62106050)
This publication has 29 references indexed in Scilit:
- ScanNet: Richly-Annotated 3D Reconstructions of Indoor Scenes2017
- Pyramid Scene Parsing Network2017
- Image-to-Image Translation with Conditional Adversarial Networks2017
- Deep Residual Learning for Image Recognition2016
- The Cityscapes Dataset for Semantic Urban Scene Understanding2016
- SUN RGB-D: A RGB-D scene understanding benchmark suite2015
- Fully convolutional networks for semantic segmentation2015
- The Role of Context for Object Detection and Semantic Segmentation in the Wild2014
- Vision meets robotics: The KITTI datasetThe International Journal of Robotics Research, 2013
- The Pascal Visual Object Classes (VOC) ChallengeInternational Journal of Computer Vision, 2009