Abstract
Rubbing served as a crucial cultural carrier, transferring characters from steles onto paper using ink, thereby facilitating greater dissemination and long-term preservation. However, prolonged corrosion, inclement weather, and other factors cause various rubbing deteriorations. Therefore, an automated rubbing image restoration method is highly desirable to reduce the complexity of manual restoration procedures. In particular, when we refer to restoring a rubbing image, we mean recreating the original text on the rubbing image to reflect its original appearance. Existing methods, such as image denoising, can address minor deterioration but cannot handle severe deterioration. Image inpainting methods attempt to handle large areas of deterioration but generally struggle to produce contextually consistent strokes due to a lack of control in the restoration process. In addition, currently, there is no reliable method for rubbing character recognition. In this article, we propose a novel 2-stage rubbing image restoration method that performs well on different levels of deterioration. In the first stage, we integrate visual and contextual information for text recognition in rubbing images, including those that are heavily deteriorated. The second stage includes a multi-prior conditional latent diffusion model for rubbing image restoration, utilizing the character identities recognized in the first stage and undeteriorated characters as priors to guide the restoration process. Extensive experiments have demonstrated the effectiveness of our method compared to existing approaches.
Funding Information
  • Research Grants Council of the Hong Kong SAR, China (Project No. UGC/FDS11/E03/22)
  • National Natural Science Foundation of China (No. 62273241)
  • Natural Science Foundation of Guangdong Province, China (No. 2024A1515011946)
  • Shenzhen Research Foundation for Basic Research, China (No. JCYJ2025060418190054)
  • National Science and Technology Council, Taiwan (Grant 114-2221-E-006-114-MY3)

This publication has 24 references indexed in Scilit: