Terrain-Informed Self-Supervised Learning: Enhancing Building Footprint Extraction From LiDAR Data With Limited Annotations
- 19 April 2024
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Geoscience and Remote Sensing
- Vol. 62 (01962892) , 1-10
Abstract
Estimating building footprint maps from geospatial data is vital in urban planning, development, disaster management, and various other applications. Deep learning methodologies have gained prominence in building segmentation maps, offering the promise of precise footprint extraction without extensive postprocessing. However, these methods face challenges in generalization and label efficiency, particularly in remote sensing, where obtaining accurate labels can be both expensive and time consuming. To address these challenges, we propose terrain-aware self-supervised learning (SSL), tailored to remote sensing, using digital elevation models (DEMs) from light detection and ranging (LiDAR) data. We propose to learn a model to differentiate between bare Earth and superimposed structures enabling the network to implicitly learn domain-relevant features without the need for extensive pixel-level annotations. We test the effectiveness of our approach by evaluating building segmentation performance on test datasets with varying label fractions. Remarkably, with only 1% of the labels (equivalent to 25 labeled examples), our method improves over ImageNet pretraining, showing the advantage of leveraging unlabeled data for feature extraction in the domain of remote sensing. The performance improvement is more pronounced in few-shot scenarios and gradually closes the gap with ImageNet pretraining as the label fraction increases. We test on a dataset characterized by substantial distribution shifts (including resolution variation and labeling errors) to demonstrate the generalizability of our approach. When compared with other baselines, including ImageNet pretraining and more complex architectures, our approach consistently performs better, demonstrating the efficiency and effectiveness of self-supervised terrain-aware feature learning.Keywords
All Related Versions
Funding Information
- Research Council of Norway through the Project “ATELIER-EO: Automated Machine Learning Framework Tailored to Earth Observation” (336990)
This publication has 37 references indexed in Scilit:
- Automatic 3D building reconstruction from multi-view aerial images with deep learningISPRS Journal of Photogrammetry and Remote Sensing, 2021
- Squeeze-and-Excitation Networks2018
- The Unreasonable Effectiveness of Deep Features as a Perceptual Metric2018
- Generalised Dice Overlap as a Deep Learning Loss Function for Highly Unbalanced Segmentations2017
- A general-purpose framework for parallel processing of large-scale LiDAR dataInternational Journal of Digital Earth, 2017
- Deep Residual Learning for Image Recognition2016
- U-Net: Convolutional Networks for Biomedical Image Segmentation2015
- Fully convolutional networks for semantic segmentation2015
- Data fusion of high-resolution satellite imagery and LiDAR data for automatic building extractionISPRS Journal of Photogrammetry and Remote Sensing, 2007
- Multiscale structural similarity for image quality assessment2004