LOANet: a lightweight network using object attention for extracting buildings and roads from UAV aerial remote sensing images
Authors:
Open Access
- 11 July 2023
- journal article
- research article
- Published by PeerJ in PeerJ Computer Science
- Vol. 9, e1467
Abstract
Semantic segmentation for extracting buildings and roads from uncrewed aerial vehicle (UAV) remote sensing images by deep learning becomes a more efficient and convenient method than traditional manual segmentation in surveying and mapping fields. In order to make the model lightweight and improve the model accuracy, a lightweight network using object attention (LOANet) for buildings and roads from UAV aerial remote sensing images is proposed. The proposed network adopts an encoder-decoder architecture in which a lightweight densely connected network (LDCNet) is developed as the encoder. In the decoder part, the dual multi-scale context modules which consist of the atrous spatial pyramid pooling module (ASPP) and the object attention module (OAM) are designed to capture more context information from feature maps of UAV remote sensing images. Between ASPP and OAM, a feature pyramid network (FPN) module is used to fuse multi-scale features extracted from ASPP. A private dataset of remote sensing images taken by UAV which contains 2431 training sets, 945 validation sets, and 475 test sets is constructed. The proposed basic model performs well on this dataset, with only 1.4M parameters and 5.48G floating point operations (FLOPs), achieving excellent mean Intersection-over-Union (mIoU). Further experiments on the publicly available LoveDA and CITY-OSM datasets have been conducted to further validate the effectiveness of the proposed basic and large model, and outstanding mIoU results have been achieved. All codes are available on https://github.com/GtLinyer/LOANet.Keywords
All Related Versions
Funding Information
- The National Natural Science Foundation of China (61801288)
- The Excellent Doctoral/Master’s Dissertation Cultivation Project of Shanghai University of Medicine & Health Sciences
- The National Natural Science Foundation of China
This publication has 20 references indexed in Scilit:
- Accurate Building Extraction from Fused DSM and UAV Images Using a Chain Fully Convolutional Neural NetworkRemote Sensing, 2019
- Road Extraction from Unmanned Aerial Vehicle Remote Sensing Images Based on Improved Neural NetworksSensors, 2019
- DeepUNet: A Deep Fully Convolutional Network for Pixel-Level Sea-Land SegmentationIEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, 2018
- Learning Aerial Image Segmentation From Online MapsIEEE Transactions on Geoscience and Remote Sensing, 2017
- Hourglass-ShapeNetwork Based Semantic Segmentation for High Resolution Aerial ImageryRemote Sensing, 2017
- Classification for High Resolution Remote Sensing Imagery Using a Fully Convolutional NetworkRemote Sensing, 2017
- DeepLab: Semantic Image Segmentation with Deep Convolutional Nets, Atrous Convolution, and Fully Connected CRFsIEEE Transactions on Pattern Analysis and Machine Intelligence, 2017
- SegNet: A Deep Convolutional Encoder-Decoder Architecture for Image SegmentationIEEE Transactions on Pattern Analysis and Machine Intelligence, 2017
- Convolutional Neural Networks for Large-Scale Remote-Sensing Image ClassificationIEEE Transactions on Geoscience and Remote Sensing, 2016
- Fully Convolutional Networks for Semantic SegmentationIEEE Transactions on Pattern Analysis and Machine Intelligence, 2016