A screen‐shooting resilient document image watermarking scheme using deep neural network
Authors:
Open Access
- 2 November 2022
- journal article
- review article
- Published by Institution of Engineering and Technology (IET) in IET Image Processing
- Vol. 17 (2) , 323-336
Abstract
With the advent of the screen‐reading era, the confidential documents displayed on the screen can be easily captured by a camera without leaving any traces. Thus, this paper proposes a novel screen‐shooting resilient watermarking scheme for document image using deep neural network. By applying this scheme, when the watermarked image is displayed on the screen and captured by a camera, the watermark can be still extracted from the captured photographs. Specifically, the scheme is an end‐to‐end neural network with an encoder to embed watermark and a decoder to extract watermark. During the training process, a distortion layer between encoder and decoder is added to simulate the distortions introduced by screen‐shooting process in real scenes, such as camera distortion, shooting distortion, and light source distortion. Furthermore, a background sensitive loss and a lpips loss are used to improve visual quality of the watermarked document images in the training process. Besides, a strength factor adjustment strategy is also designed to improve the visual quality with little loss of bit extraction accuracy. The experimental results show that the proposed scheme has higher visual quality and robustness than the other two recent state‐of‐the‐art methods.Keywords
All Related Versions
Funding Information
- Priority Academic Program Development of Jiangsu Higher Education Institutions
- Qinglan Project of Jiangsu Province of China
- National Natural Science Foundation of China (61732021, 61825203, 62102189, 62122032, 62172233, 61932011, U1736203, 61931004, U1936118)
This publication has 32 references indexed in Scilit:
- U-Net: Convolutional Networks for Biomedical Image Segmentation2015
- Robust watermarking against print and scan attack through efficient modeling algorithmSignal Processing: Image Communication, 2014
- Photon, Poisson Noise2014
- Toward an interactive poster using digital watermarking and a mobile phone cameraSignal, Image and Video Processing, 2011
- Multiple Domain Watermarking for Print-Scan and JPEG Resilient Data Hiding2008
- Image Fingerprinting Scheme for Print-and-Capture Model2006
- Fast watermark detection scheme for camera-equipped cellular phone2004
- Image quality assessment: from error visibility to structural similarityIEEE Transactions on Image Processing, 2004
- A DWT-DFT composite watermarking scheme robust to both affine transform and JPEG compressionIEEE Transactions on Circuits and Systems for Video Technology, 2003
- Robust template matching for affine resistant image watermarksIEEE Transactions on Image Processing, 2000