3-D Thermal City Reconstruction via Thermal Mapping With RGB-Mesh Guidance
- 12 January 2026
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Geoscience and Remote Sensing
- Vol. 64 (01962892) , 1-14
Abstract
Acquiring the temperatures of a 3D city model at different times and under various climatic conditions is crucial for building energy management, diagnosis, and heat distribution analysis, contributing to sustainable city development. While 3D thermal model reconstruction has been utilized for this purpose, previous methods have faced challenges with scalability and accuracy. In this paper, we propose a novel framework for 3D thermal city reconstruction with thermal mapping guided by an RGB model. Our framework consists of four steps: (1) building a high-quality reference RGB model, (2) registering thermal images to the RGB model via view synthesis and cross-modality thermal-to-visible image matching, (3) establishing pixel-level correspondence between the RGB and thermal images, and generating thermal mapping images with pixel-level alignment, and (4) converting the thermal values on the images to temperatures, and applying texture mapping to reconstruct the high-precision 3D city temperature model. The advantage of our framework is the need to build an RGB model only once, which can then guide thermal model reconstruction at any time. Our method achieves comparable geometric accuracy to the RGB model, with a C2M distance of the order of 10e-8, and superior texture quality to the direct use of thermal images, with more than 10% improvement in PSNR and SSIM, and the best performance in LPIPS.Keywords
Funding Information
- National Natural Science Foundation of China (62171451)
This publication has 45 references indexed in Scilit:
- Thermal point clouds of buildings: A reviewEnergy and Buildings, 2022
- Investigation on performance of RGB point cloud and thermal information data fusion for 3D building thermal map modeling using aerial images under different experimental conditionsJournal of Building Engineering, 2022
- Fusion of urban 3D point clouds with thermal attributes using MLS data and TIR image sequencesInfrared Physics & Technology, 2021
- Fusion of thermal imagery with point clouds for building façade thermal attribute mappingISPRS Journal of Photogrammetry and Remote Sensing, 2019
- Camera pose refinement by matching uncertain 3D building models with thermal infrared image sequences for high quality texture extractionISPRS Journal of Photogrammetry and Remote Sensing, 2017
- A mobile robot based system for fully automated thermal 3D mappingAdvanced Engineering Informatics, 2014
- HeatWave: A handheld 3D thermography system for energy auditingEnergy and Buildings, 2013
- An automated vision-based method for rapid 3D energy performance modeling of existing buildings using thermal and digital imageryAdvanced Engineering Informatics, 2013
- Novel approach to 3D thermography and energy efficiency evaluationEnergy and Buildings, 2012
- Infrared Thermography2009