Spalling segmentation on tuffeau limestone heritage facades using RGB–thermal fusion
Open Access
- 9 November 2026
- conference paper
- Published by Association for Computing Machinery (ACM)
- p. 13-21
Abstract
Spalling is a common deterioration process in the porous tuffeau limestone of Loire Valley heritage monuments. It involves the local detachment of surface layers and, when it progresses, leaves the underlying stone exposed to further weathering. At present, damaged areas are generally mapped through visual inspection by conservation specialists. Although this procedure provides valuable expert assessment, applying it systematically to large façades is time-consuming, and the resulting maps may be difficult to reproduce across inspection campaigns. This paper investigates the automatic segmentation of spalling by combining RGB images and passive infrared thermography (IRT), using data acquired on the south-east façade of the Château de Chambord. We introduce an RGB–thermal dataset covering ten spalling defects, with 73 registered image pairs and geometrically consistent masks generated through 3D ortho-reprojection across viewpoints and sensors. We benchmark single-modality baselines and early, intermediate, and late RGB–thermal fusion strategies across several backbones. We further propose TTV-Net, a thermo-visual segmentation architecture that injects thermal evidence into RGB features through context-gated thermal injection based on normalized temperature, local thermal residuals, and thermal-gradient cues. Under grouped three-fold cross-validation by defect, TTV-Net obtains the highest mean performance, reaching an IoU of 0.818 and an F1-score of 0.899. It improves slightly over the strongest standard fusion baseline, which reaches 0.795 IoU, and more clearly over the best RGB-only and thermal-only models, which reach 0.705 and 0.482 IoU, respectively.Keywords
This publication has 28 references indexed in Scilit:
- Delamination detection in concrete decks using numerical simulation and UAV-based infrared thermography with deep learningAutomation in Construction, 2024
- Crack detection of masonry structure based on thermal and visible image fusion and semantic segmentationAutomation in Construction, 2023
- Detection of limestone spalling in 3D survey images using deep learningAutomation in Construction, 2023
- Fusion of thermal and RGB images for automated deep learning based crack detection in civil infrastructureAI in Civil Engineering, 2022
- Transformers with YOLO Network for Damage Detection in Limestone Wall Images2022
- Deep learning and infrared thermography for asphalt pavement crack severity classificationAutomation in Construction, 2022
- Stone-by-Stone Segmentation for Monitoring Large Historical Monuments Using Deep Neural Networks2021
- Gypsum and spalling decay mechanism of tuffeau limestoneEnvironmental Earth Sciences, 2015
- Infrared thermographic inspection of murals and characterization of degradation in historic monumentsConstruction and Building Materials, 2013
- The occurrence of gypsum in the scaling of stones at the Castle of Chambord (France)Environmental Earth Sciences, 2013