Abstract
Spalling is a common deterioration process in the porous tuffeau limestone of Loire Valley heritage monuments. It involves the local detachment of surface layers and, when it progresses, leaves the underlying stone exposed to further weathering. At present, damaged areas are generally mapped through visual inspection by conservation specialists. Although this procedure provides valuable expert assessment, applying it systematically to large façades is time-consuming, and the resulting maps may be difficult to reproduce across inspection campaigns. This paper investigates the automatic segmentation of spalling by combining RGB images and passive infrared thermography (IRT), using data acquired on the south-east façade of the Château de Chambord. We introduce an RGB–thermal dataset covering ten spalling defects, with 73 registered image pairs and geometrically consistent masks generated through 3D ortho-reprojection across viewpoints and sensors. We benchmark single-modality baselines and early, intermediate, and late RGB–thermal fusion strategies across several backbones. We further propose TTV-Net, a thermo-visual segmentation architecture that injects thermal evidence into RGB features through context-gated thermal injection based on normalized temperature, local thermal residuals, and thermal-gradient cues. Under grouped three-fold cross-validation by defect, TTV-Net obtains the highest mean performance, reaching an IoU of 0.818 and an F1-score of 0.899. It improves slightly over the strongest standard fusion baseline, which reaches 0.795 IoU, and more clearly over the best RGB-only and thermal-only models, which reach 0.705 and 0.482 IoU, respectively.

This publication has 28 references indexed in Scilit: