Enhancing Geo-Transferability in Building Function Classification Through Similar Place Knowledge Retrieval
- 28 January 2026
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Geoscience and Remote Sensing
- Vol. 64 (01962892) , 1-10
Abstract
Understanding the use of buildings (i.e., building functions) is crucial for effective urban management and policy making. Recently, many deep learning-based models have been developed to identify building functions. However, their high performance depends on a large labeled dataset, which is a significant challenge for cities with limited labeled data. To close this gap, we propose a similar-place knowledge-retrieval-based framework for building function identification that enables a trained model to be directly applied/transferred to other cities without additional training needed. Our approach combines remote sensing imagery, POI data, and building footprints to capture the macro and micro built environment. Specifically, this framework includes two different modules: 1) a geo-aware transformer-based model to capture fine-grained spatial interactions between buildings; 2) a hierarchical node clustering algorithm with a similar-place knowledge-retrieval layer for portraying the coarse-grained features. This combination clusters all neighbors of a target building into a ’place’ and then conducts a coarse-grained knowledge transfer based on the similarity match. The evaluation conducted across nine cities demonstrates that the proposed model outperforms all state-of-the-art baselines, achieving an average improvement of 21.98% in cross-city predictions, as measured by Cohen’s kappa coefficient. More importantly, the ablation study shows that integrating our knowledge-retrieval layer into other deep-learning baselines significantly improves their cross-city prediction performance. Additionally, the transferability performance analysis indicates that greater similarity between the sample distributions in the source and target cities contributes to the proposed model’s higher transferability. In summary, the proposed knowledge-retrieval layer is an effective and reliable component for enhancing cross-city prediction and has strong potentials for application in cities without labeled data to support city management and sustainable urban planning.Keywords
Funding Information
- China Scholarship Council
This publication has 29 references indexed in Scilit:
- Cross-city matters: A multimodal remote sensing benchmark dataset for cross-city semantic segmentation using high-resolution domain adaptation networksRemote Sensing of Environment, 2023
- Building use and mixed-use classification with a transformer-based network fusing satellite images and geospatial textual informationRemote Sensing of Environment, 2023
- Cross-city Landuse classification of remote sensing images via deep transfer learningInternational Journal of Applied Earth Observation and Geoinformation, 2023
- Inferring building function: A novel geo-aware neural network supporting building-level function classificationSustainable Cities and Society, 2022
- Can linguistic features extracted from geo-referenced tweets help building function classification in remote sensing?ISPRS Journal of Photogrammetry and Remote Sensing, 2022
- An interpretable method for identifying mislabeled commercial building based on temporal feature extraction and ensemble classifierSustainable Cities and Society, 2022
- Forecasting land-use changes in Mashhad Metropolitan area using Cellular Automata and Markov chain model for 2016-2030Sustainable Cities and Society, 2021
- Mapping essential urban land use categories in China (EULUC-China): preliminary results for 2018Science Bulletin, 2020
- Land-cover classification with high-resolution remote sensing images using transferable deep modelsRemote Sensing of Environment, 2020
- Semantic classification of urban buildings combining VHR image and GIS data: An improved random forest approachISPRS Journal of Photogrammetry and Remote Sensing, 2015