CNN-Enhanced Heterogeneous Graph Convolutional Network: Inferring Land Use from Land Cover with a Case Study of Park Segmentation
Open Access
- 9 October 2022
- journal article
- research article
- Published by MDPI AG in Remote Sensing
- Vol. 14 (19) , 5027
Abstract
Land use segmentation is a fundamental yet challenging task in remote sensing. Most current methods mainly take images as input and sometimes cannot achieve satisfactory results due to limited information. Inspired by the inherent relations between land cover and land use, we investigate land use segmentation using additional land cover data. The topological relations among land cover objects are beneficial for bridging the semantic gap between land cover and land use. Specifically, these relations are usually depicted by a geo-object-based graph structure. Deep convolutional neural networks (CNNs) are capable of extracting local patterns but fail to efficiently explore topological relations. In contrast, contextual relations among objects can be easily captured by graph convolutional networks (GCNs). In this study, we integrated CNNs and GCNs and proposed the CNN-enhanced HEterogeneous Graph Convolutional Network (CHeGCN) to incorporate local spectral-spatial features and long-range dependencies. We represent topological relations by heterogeneous graphs which are constructed with images and land cover data. Afterwards, we employed GCNs to build topological relations by graph reasoning. Finally, we fused CNN and GCN features to accomplish the inference from land cover to land use. Compared with other homogeneous graph-based models, the land cover data provide more sufficient information for graph reasoning. The proposed method can achieve the transformation from land cover to land use. Extensive experiments showed the competitive performance of CHeGCN and demonstrated the positive effects of land cover data. On the IoU metric over two datasets, CHeGCN outperforms CNNs and GCNs by nearly 3.5% and 5%, respectively. In contrast to homogeneous graphs, heterogeneous graphs have an IoU improvement of approximately 2.5% in the ablation experiments. Furthermore, the generated visualizations help explore the underlying mechanism of CHeGCN. It is worth noting that CHeGCN can be easily degenerated to scenarios where no land cover information is available and achieves satisfactory performance.Keywords
Funding Information
- National Key Research and Development Program of China (2021YFB3900503, 2022127, 2020KTYWLZX03, 2021KTYWLZX07)
- Youth Innovation Promotion Association, CAS (2021YFB3900503, 2022127, 2020KTYWLZX03, 2021KTYWLZX07)
- “Future Star” Talent Plan of Aerospace Information Research Institute, Chinese Academy of Sciences (2021YFB3900503, 2022127, 2020KTYWLZX03, 2021KTYWLZX07)
This publication has 36 references indexed in Scilit:
- Deep Learning Earth Observation Classification Using ImageNet Pretrained NetworksIEEE Geoscience and Remote Sensing Letters, 2015
- From land cover-graphs to urban structure typesInternational Journal of Geographical Information Science, 2013
- A review of regional science applications of satellite remote sensing in urban settingsComputers, Environment and Urban Systems, 2013
- Finer resolution observation and monitoring of global land cover: first mapping results with Landsat TM and ETM+ dataInternational Journal of Remote Sensing, 2012
- Community detection in spatial networks: Inferring land use from a planar graph of land cover objectsInternational Journal of Applied Earth Observation and Geoinformation, 2012
- SLIC Superpixels Compared to State-of-the-Art Superpixel MethodsIEEE Transactions on Pattern Analysis and Machine Intelligence, 2012
- Rule-based classification of multi-temporal satellite imagery for habitat and agricultural land cover mappingISPRS Journal of Photogrammetry and Remote Sensing, 2007
- From Land Cover to Land Use: A Methodology for Efficient Land Use Mapping over Large AreasThe Professional Geographer, 2001
- Human Domination of Earth's EcosystemsScience, 1997
- Distinguishing urban land-use categories in fine spatial resolution land-cover data using a graph-based, structural pattern recognition systemComputers, Environment and Urban Systems, 1997