A Dual-Path and Lightweight Convolutional Neural Network for High-Resolution Aerial Image Segmentation
Open Access
- 12 December 2019
- journal article
- research article
- Published by MDPI AG in ISPRS International Journal of Geo-Information
- Vol. 8 (12) , 582
Abstract
Semantic segmentation on high-resolution aerial images plays a significant role in many remote sensing applications. Although the Deep Convolutional Neural Network (DCNN) has shown great performance in this task, it still faces the following two challenges: intra-class heterogeneity and inter-class homogeneity. To overcome these two problems, a novel dual-path DCNN, which contains a spatial path and an edge path, is proposed for high-resolution aerial image segmentation. The spatial path, which combines the multi-level and global context features to encode the local and global information, is used to address the intra-class heterogeneity challenge. For inter-class homogeneity problem, a Holistically-nested Edge Detection (HED)-like edge path is employed to detect the semantic boundaries for the guidance of feature learning. Furthermore, we improve the computational efficiency of the network by employing the backbone of MobileNetV2. We enhance the performance of MobileNetV2 with two modifications: (1) replacing the standard convolution in the last four Bottleneck Residual Blocks (BRBs) with atrous convolution; and (2) removing the convolution stride of 2 in the first layer of BRBs 4 and 6. Experimental results on the ISPRS Vaihingen and Potsdam 2D labeling dataset show that the proposed DCNN achieved real-time inference speed on a single GPU card with better performance, compared with the state-of-the-art baselines.Keywords
Funding Information
- Youth Innovation Promotion Association of the Chinese Academy of Sciences (2016336)
This publication has 37 references indexed in Scilit:
- Semantic labeling in very high resolution images via a self-cascaded convolutional neural networkISPRS Journal of Photogrammetry and Remote Sensing, 2018
- Classification with an edge: Improving semantic image segmentation with boundary detectionISPRS Journal of Photogrammetry and Remote Sensing, 2018
- Deep Learning in Remote Sensing: A Comprehensive Review and List of ResourcesIEEE Geoscience and Remote Sensing Magazine, 2017
- Densely Connected Convolutional Networks2017
- DeepLab: Semantic Image Segmentation with Deep Convolutional Nets, Atrous Convolution, and Fully Connected CRFsIEEE Transactions on Pattern Analysis and Machine Intelligence, 2017
- SegNet: A Deep Convolutional Encoder-Decoder Architecture for Image SegmentationIEEE Transactions on Pattern Analysis and Machine Intelligence, 2017
- ImageNet Large Scale Visual Recognition ChallengeInternational Journal of Computer Vision, 2015
- Random forest classifier for remote sensing classificationInternational Journal of Remote Sensing, 2005
- Image processing with neural networks—a reviewPattern Recognition, 2002
- Morphological segmentationJournal of Visual Communication and Image Representation, 1990