A Generative Adversarial Network with Spatial Attention Mechanism for Building Structure Inference Based on Unmanned Aerial Vehicle Remote Sensing Images
Open Access
- 6 September 2023
- journal article
- research article
- Published by MDPI AG in Remote Sensing
- Vol. 15 (18) , 4390
Abstract
The acquisition of building structures has broad applications across various fields. However, existing methods for inferring building structures predominantly depend on manual expertise, lacking sufficient automation. To tackle this challenge, we propose a building structure inference network that utilizes UAV remote sensing images, with the PIX2PIX network serving as the foundational framework. We enhance the generator by incorporating an additive attention module that performs multi-scale feature fusion, enabling the combination of features from diverse spatial resolutions of the feature map. This modification enhances the model’s capability to emphasize global relationships during the mapping process. To ensure the completeness of line elements in the generator’s output, we design a novel loss function based on the Hough transform. A line penalty term is introduced that transforms the output of the generator and ground truth to the Hough domain due to the original loss function’s inability to effectively constrain the completeness of straight-line elements in the generated results in the spatial domain. A dataset of the appearance features obtained from UAV remote sensing images and the internal floor plan structure is made. Using UAV remote sensing images of multi-story residential buildings, high-rise residential buildings, and office buildings as test collections, the experimental results show that our method has better performance in inferring a room’s layout and the locations of load-bearing columns, achieving an average improvement of 11.2% and 21.1% over PIX2PIX in terms of the IoU and RMSE, respectively.Keywords
This publication has 31 references indexed in Scilit:
- Automatic reconstruction of 3D building models from scanned 2D floor plansAutomation in Construction, 2016
- Advanced procedural modeling of architectureACM Transactions on Graphics, 2015
- Unmanned aerial systems for photogrammetry and remote sensing: A reviewISPRS Journal of Photogrammetry and Remote Sensing, 2014
- Sourcing stone for the conservation and repair of historical buildings in BritainQuarterly Journal of Engineering Geology and Hydrogeology, 2013
- Unsupervised Wall Detector in Architectural Floor Plans2013
- Seismic performance of composite reinforced concrete and steel moment frame structures – state-of-the-artComposites Part B: Engineering, 2011
- Energy appproach in peformance‐based seismic design of steel moment resisting frames for basic safety objectiveThe Structural Design of Tall Buildings, 2001
- Introduction to shape and shape grammarsEnvironment and Planning B: Planning and Design, 1980
- Use of the Hough transformation to detect lines and curves in picturesCommunications of the ACM, 1972
- MICRITIC ENVELOPES OF CARBONATE GRAINS ARE NOT EXCLUSIVELY OF PHOTOSYNTHETIC ALGAL ORIGINSedimentology, 1971