ResUNet-a: a deep learning framework for semantic segmentation of remotely sensed data
Authors:
- Foivos I. DiakogiannisFDFoivos I. Diakogiannis
- François WaldnerFWFrançois Waldner
Preprint
Abstract
Scene understanding of high resolution aerial images is of great importance for the task of automated monitoring in various remote sensing applications. Due to the large within-class and small between-class variance in pixel values of objects of interest, this remains a challenging task. In recent years, deep convolutional neural networks have started being used in remote sensing applications and demonstrate state of the art performance for pixel level classification of objects. Here we present a novel deep learning architecture, \resuneta, that combines ideas from various state of the art modules used in computer vision for semantic segmentation tasks. We analyse the performance of several flavours of the Generalized Dice loss for semantic segmentation, and we introduce a novel variant loss function for semantic segmentation of objects that has better convergence properties and behaves well even under the presence of highly imbalanced classes. The performance of our modeling framework is evaluated on the ISPRS 2D Potsdam dataset. Results show state-of-the-art performance with an average F1 score of 92.9% over all classes for our best model.Keywords
All Related Versions
This publication has 55 references indexed in Scilit:
- Beyond RGB: Very high resolution urban remote sensing with multimodal deep networksISPRS Journal of Photogrammetry and Remote Sensing, 2018
- Classification with an edge: Improving semantic image segmentation with boundary detectionISPRS Journal of Photogrammetry and Remote Sensing, 2018
- Generalised Dice Overlap as a Deep Learning Loss Function for Highly Unbalanced Segmentations2017
- Semantic Segmentation of Earth Observation Data Using Multimodal and Multi-scale Deep Networks2017
- The Importance of Skip Connections in Biomedical Image Segmentation2016
- Identity Mappings in Deep Residual Networks2016
- U-Net: Convolutional Networks for Biomedical Image Segmentation2015
- Geographic Object-Based Image Analysis – Towards a new paradigmISPRS Journal of Photogrammetry and Remote Sensing, 2014
- The Pascal Visual Object Classes (VOC) ChallengeInternational Journal of Computer Vision, 2009
- Comparison of the predicted and observed secondary structure of T4 phage lysozymeBiochimica et Biophysica Acta (BBA) - Protein Structure, 1975