Assessing Deep Convolutional Neural Networks and Assisted Machine Perception for Urban Mapping
Open Access
- 15 April 2021
- journal article
- research article
- Published by MDPI AG in Remote Sensing
- Vol. 13 (8) , 1523
Abstract
High-spatial-resolution satellite imagery has been widely applied for detailed urban mapping. Recently, deep convolutional neural networks (DCNNs) have shown promise in certain remote sensing applications, but they are still relatively new techniques for general urban mapping. This study examines the use of two DCNNs (U-Net and VGG16) to provide an automatic schema to support high-resolution mapping of buildings, road/open built-up, and vegetation cover. Using WorldView-2 imagery as input, we first applied an established OBIA method to characterize major urban land cover classes. An OBIA-derived urban map was then divided into a training and testing region to evaluate the DCNNs’ performance. For U-Net mapping, we were particularly interested in how sample size or the number of image tiles affect mapping accuracy. U-Net generated cross-validation accuracies ranging from 40.5 to 95.2% for training sample sizes from 32 to 4096 image tiles (each tile was 256 by 256 pixels). A per-pixel accuracy assessment led to 87.8 percent overall accuracy for the testing region, suggesting U-Net’s good generalization capabilities. For the VGG16 mapping, we proposed an object-based framing paradigm that retains spatial information and assists machine perception through Gaussian blurring. Gaussian blurring was used as a pre-processing step to enhance the contrast between objects of interest and background (contextual) information. Combined with the pre-trained VGG16 and transfer learning, this analytical approach generated a 77.3 percent overall accuracy for per-object assessment. The mapping accuracy could be further improved given more robust segmentation algorithms and better quantity/quality of training samples. Our study shows significant promise for DCNN implementation for urban mapping and our approach can transfer to a number of other remote sensing applications.Keywords
Funding Information
- National Aeronautics and Space Administration (NNH16ZDA001N-LCLUC)
This publication has 34 references indexed in Scilit:
- Remote Sensing of the Marine Environment: Challenges and Opportunities in the Galapagos Islands of Ecuador2013
- A comprehensive review of earthquake-induced building damage detection with remote sensing techniquesISPRS Journal of Photogrammetry and Remote Sensing, 2013
- Broad-Scale Monitoring of Tillage Practices Using Sequential Landsat ImagerySoil Science Society of America Journal, 2013
- A comparative analysis of high spatial resolution IKONOS and WorldView-2 imagery for mapping urban tree speciesRemote Sensing of Environment, 2012
- Monitoring Urban Tree Cover Using Object-Based Image Analysis and Public Domain Remotely Sensed DataRemote Sensing, 2011
- Shadow detection and building-height estimation using IKONOS dataInternational Journal of Remote Sensing, 2011
- Object-based urban detailed land cover classification with high spatial resolution IKONOS imageryInternational Journal of Remote Sensing, 2011
- QuickBird and Hyperion data analysis of an invasive plant species in the Galapagos Islands of Ecuador: Implications for control and land use managementRemote Sensing of Environment, 2008
- Data fusion of high-resolution satellite imagery and LiDAR data for automatic building extractionISPRS Journal of Photogrammetry and Remote Sensing, 2007
- Object-based Detailed Vegetation Classification with Airborne High Spatial Resolution Remote Sensing ImageryPhotogrammetric Engineering & Remote Sensing, 2006