Multi-Source Digital Documentation and YOLO–HBIM Deterioration Information Management for Qiaopi Office–Residence Heritage in Lingnan Under Disaster-Prone Weather Conditions
Open Access
Abstract
Integrated qiaopi office–residence heritage preserves the material setting of remittance-letter operations together with domestic, educational, and ritual activities. In Lingnan’s hot–humid and disaster-prone environment, condition records need to be repeatable, spatially traceable, and continuously updatable. Taking Jingzu Jiashu and Mingde Jiashu, two former qiaopi office sites in Chaoshan, as case studies, this research develops an evidence-traceable digital conservation workflow integrating multi-source documentation; an adopted YOLOv8 surface-deterioration baseline; qualitative Grad-CAM visualization; structured deterioration records; and semi-automatic, human-confirmed Revit/HBIM association. UAV and terrestrial photography, mobile LiDAR/scanning, handheld measurement, measured drawings, point-cloud and reality-based products, and geometric models were organized into case-specific HBIM environments. The adopted deterioration dataset comprised 362 original images at 512 × 512 pixels and 2024 bounding-box annotations for five visually identifiable categories: spalling, staining, plants, saltpetering, and crack. The original images were divided into 253 training, 72 validation, and 37 independent-test images, while augmentation was restricted to the training subset, increasing the training pool to 1600 images. The previously established YOLOv8 baseline achieved a Precision of 0.85, Recall of 0.72, mAP50 of 0.83, and mAP50–95 of 0.58. Grad-CAM heatmaps were used as qualitative aids to examine model-emphasized image regions. Retained detections associated with Jingzu Jiashu and Mingde Jiashu were converted into versioned records containing source-image identifiers, deterioration classes, detector confidence, survey information, spatial references, verification states, and revision histories. Candidate spatial associations were generated through case identifiers, façade or space zones, element identifiers, and available spatial evidence, while final M1–M3 associations required human confirmation. By preserving source provenance, spatial uncertainty, and record histories, the workflow provides an auditable information basis for routine inspection, post-event review, maintenance prioritization, repair interpretation, and resilience-oriented preventive conservation. The workflow supports screening-level deterioration recognition and information management but does not provide causal diagnosis, structural assessment, exact affected-area measurement, building-independent generalization, or automatic repair recommendations.Keywords
Funding Information
- Macao Polytechnic University (RP/FCHS-03/2022)
This publication has 35 references indexed in Scilit:
- A state-of-the-art empirical round robin validation of heat, air and moisture (HAM) modelsBuilding and Environment, 2025
- Heritage building information modeling (HBIM) for heritage conservation: Framework of challenges, gaps, and existing limitations of HBIMDigital Applications in Archaeology and Cultural Heritage, 2024
- Integration of point cloud, historical records, and condition assessment data in HBIMAutomation in Construction, 2024
- Building defect inspection and data management using computer vision, augmented reality, and BIM technologyAutomation in Construction, 2024
- Adaptive measures for preserving heritage buildings in the face of climate change: A reviewBuilding and Environment, 2023
- Systematic approach to generate Historical Building Information Modelling (HBIM) in architectural restoration projectAutomation in Construction, 2022
- Climate change impacts on cultural heritage: A literature reviewWires Climate Change, 2021
- An historical building information modelling approach for the preventive conservation of historical constructions: Application to the Historical Library of SalamancaAutomation in Construction, 2021
- HBIM for storing life-cycle data regarding decay and damage in existing timber structuresAutomation in Construction, 2020
- Assessment of wind-driven rain impact, related surface erosion and surface strength reduction of historic building materialsBuilding and Environment, 2012