Yichi Zhang

In rockfall hazard management, the investigation and detection of potential rockfall source areas on rock cliffs by remote-sensing-based susceptibility analysis are of primary importance. However, when the rockfall analysis results are used as feedback to the fieldwork, the irregular slope surface morphology makes it difficult to objectively locate the risk zones of hazard maps on the real slopes, and the problem of straightforward on-site visualization of rockfall susceptibility remains a research gap. This paper presents some of the pioneering studies on the augmented reality (AR) mapping of geospatial information from cyberspace within 2D screens to the physical world for on-site visualization, which directly recognizes the rock mass and superimposes corresponding rock discontinuities and rockfall susceptibility onto the real slopes. A novel method of edge-based tracking of the rock mass target for mobile AR is proposed, where the model edges extracted from unmanned aerial vehicle (UAV) structure-from-motion (SfM) 3D reconstructions are aligned with the corresponding actual rock mass to estimate the camera pose accurately. Specifically, the visually prominent edges of dominant structural planes were first explored and discovered to be a robust visual feature of rock mass for AR tracking. The novel approaches of visual-geometric synthetic image (VGSI) and prominent structural plane (Pro-SP) were developed to extract structural planes with identified prominent edges as 3D template models which could provide a pose estimation reference. An experiment verified that the proposed Pro-SP template model could effectively improve the edge tracking performance and quality, and this approach was relatively robust to the changes of sunlight conditions. A case study was carried out on a typical roadcut cliff in the Mentougou District of Beijing, China. The results validate the scalability of the proposed mobile AR strategy, which is applicable and suitable for cliff-scale fieldwork. The results also demonstrate the feasibility, efficiency, and significance of the geoinformation AR mapping methodology for on-site zoning and locating of potential rockfalls, and providing relevant guidance for subsequent detailed site investigation.