Soft-Aligned Gradient-Chaining Network for Height Estimation From Single Aerial Images
- 9 March 2020
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Geoscience and Remote Sensing Letters
- Vol. 18 (3) , 538-542
Abstract
Extracting elevation information from single aerial images is an important and challenging task in photogrammetry and remote sensing. The difficulty lies in the ambiguity and ill-condition of the 2-D-3-D projection. As neural networks show advantages in solving ill-posed problems, fully convolutional neural networks (FCNs) have been applied to this task and have achieved worthwhile results. However, the previous works simply focus on the application of the neural network structures originally applied to monocular depth estimations or semantic segmentations to single-image elevation estimations. This procedure ignores the task-specific weak correlation problem between the elevation systems of training labels and outputs and the one between heights of adjacent pixels. To address these problems, we use the FCN to generate height differences between adjacent pixels in specific orientations ( i.e., oriented elevation gradients), instead of directly generating the elevation values. Subsequently, the elevation gradients in the two orients of XY are combined to form a huge relationship chain, and the relative elevation of each pixel is calculated using the maximum likelihood method. Finally, a new surface-based soft alignment method is used to establish the correlation between the elevation systems of training labels and predicted outputs robustly. The quantitative evaluation on the International Society for Photogrammetry and Remote Sensing (ISPRS) Potsdam data set reveals a significant improvement of the bare FCN. The visual contrast evaluation indicates that the soft-aligned gradient-chaining network can retain more surface features, and its outputs are more reasonable and visually pleasing than the bare FCN.Keywords
Funding Information
- National Key Research and Development Program of China (2018YFC0604405)
This publication has 10 references indexed in Scilit:
- Height estimation from single aerial images using a deep convolutional encoder-decoder networkISPRS Journal of Photogrammetry and Remote Sensing, 2019
- Encoder-Decoder with Atrous Separable Convolution for Semantic Image Segmentation2018
- UAV-BASED CROPS CLASSIFICATION WITH JOINT FEATURES FROM ORTHOIMAGE AND DSM DATAThe International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences, 2018
- Deeper Depth Prediction with Fully Convolutional Residual Networks2016
- Deep Residual Learning for Image Recognition2016
- Predicting Depth, Surface Normals and Semantic Labels with a Common Multi-scale Convolutional Architecture2015
- Deep convolutional neural fields for depth estimation from a single image2015
- Towards unified depth and semantic prediction from a single image2015
- Discrete-Continuous Depth Estimation from a Single Image2014
- Make3D: Learning 3D Scene Structure from a Single Still ImageIEEE Transactions on Pattern Analysis and Machine Intelligence, 2008