Shadow Detection with Conditional Generative Adversarial Networks
Authors:
- Vu NguyenVNVu Nguyen
- Tomas F. Yago VicenteTVTomas F. Yago Vicente
- Maozheng ZhaoMZMaozheng Zhao
- Minh HoaiMHMinh Hoai
- Dimitris SamarasDSDimitris Samaras
- 1 October 2017
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 4520-4528
Abstract
We introduce scGAN, a novel extension of conditional Generative Adversarial Networks (GAN) tailored for the challenging problem of shadow detection in images. Previous methods for shadow detection focus on learning the local appearance of shadow regions, while using limited local context reasoning in the form of pairwise potentials in a Conditional Random Field. In contrast, the proposed adversarial approach is able to model higher level relationships and global scene characteristics. We train a shadow detector that corresponds to the generator of a conditional GAN, and augment its shadow accuracy by combining the typical GAN loss with a data loss term. Due to the unbalanced distribution of the shadow labels, we use weighted cross entropy. With the standard GAN architecture, properly setting the weight for the cross entropy would require training multiple GANs, a computationally expensive grid procedure. In scGAN, we introduce an additional sensitivity parameter w to the generator. The proposed approach effectively parameterizes the loss of the trained detector. The resulting shadow detector is a single network that can generate shadow maps corresponding to different sensitivity levels, obviating the need for multiple models and a costly training procedure. We evaluate our method on the large-scale SBU and UCF shadow datasets, and observe up to 17% error reduction with respect to the previous state-of-the-art method.Keywords
This publication has 21 references indexed in Scilit:
- Leave-One-Out Kernel Optimization for Shadow Detection and RemovalIEEE Transactions on Pattern Analysis and Machine Intelligence, 2017
- Large-Scale Training of Shadow Detectors with Noisily-Annotated Shadow Examples2016
- Noisy Label Recovery for Shadow Detection in Unfamiliar Domains2016
- Leave-One-Out Kernel Optimization for Shadow Detection2015
- Fully convolutional networks for semantic segmentation2015
- Single-image shadow detection and removal using paired regions2011
- Learning to recognize shadows in monochromatic natural images2010
- Detecting Ground Shadows in Outdoor Consumer Photographs2010
- Estimating natural illumination from a single outdoor image2009
- Backpropagation Applied to Handwritten Zip Code RecognitionNeural Computation, 1989