Integrating Visual and Contextual Cues for Ancient Chinese Rubbing Image Restoration
Open Access
- 8 October 2026
- journal article
- Published by Association for Computing Machinery (ACM) in ACM Transactions on Multimedia Computing, Communications, and Applications
- Vol. 22 (10) , 1-28
Abstract
Rubbing served as a crucial cultural carrier, transferring characters from steles onto paper using ink, thereby facilitating greater dissemination and long-term preservation. However, prolonged corrosion, inclement weather, and other factors cause various rubbing deteriorations. Therefore, an automated rubbing image restoration method is highly desirable to reduce the complexity of manual restoration procedures. In particular, when we refer to restoring a rubbing image, we mean recreating the original text on the rubbing image to reflect its original appearance. Existing methods, such as image denoising, can address minor deterioration but cannot handle severe deterioration. Image inpainting methods attempt to handle large areas of deterioration but generally struggle to produce contextually consistent strokes due to a lack of control in the restoration process. In addition, currently, there is no reliable method for rubbing character recognition. In this article, we propose a novel 2-stage rubbing image restoration method that performs well on different levels of deterioration. In the first stage, we integrate visual and contextual information for text recognition in rubbing images, including those that are heavily deteriorated. The second stage includes a multi-prior conditional latent diffusion model for rubbing image restoration, utilizing the character identities recognized in the first stage and undeteriorated characters as priors to guide the restoration process. Extensive experiments have demonstrated the effectiveness of our method compared to existing approaches.Keywords
Funding Information
- Research Grants Council of the Hong Kong SAR, China (Project No. UGC/FDS11/E03/22)
- National Natural Science Foundation of China (No. 62273241)
- Natural Science Foundation of Guangdong Province, China (No. 2024A1515011946)
- Shenzhen Research Foundation for Basic Research, China (No. JCYJ2025060418190054)
- National Science and Technology Council, Taiwan (Grant 114-2221-E-006-114-MY3)
This publication has 24 references indexed in Scilit:
- Diff-Font: Diffusion Model for Robust One-Shot Font GenerationInternational Journal of Computer Vision, 2024
- The Open Images Dataset V4International Journal of Computer Vision, 2020
- Residual Dense Network for Image RestorationIEEE Transactions on Pattern Analysis and Machine Intelligence, 2020
- A novel generative adversarial net for calligraphic tablet images denoisingMultimedia Tools and Applications, 2019
- The Unreasonable Effectiveness of Deep Features as a Perceptual Metric2018
- A Point Set Generation Network for 3D Object Reconstruction from a Single Image2017
- Image-to-Image Translation with Conditional Adversarial Networks2017
- Beyond a Gaussian Denoiser: Residual Learning of Deep CNN for Image DenoisingIEEE Transactions on Image Processing, 2017
- Context Encoders: Feature Learning by Inpainting2016
- Adaptive degraded document image binarizationPattern Recognition, 2006