Recaptured Screen Image Demoiréing
- 28 January 2020
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Circuits and Systems for Video Technology
- Vol. 31 (1) , 49-60
Abstract
In many situations, such as transferring data between devices and recording precious moments, we would like to capture the contents on screens using digital cameras for convenience. These recaptured screen images and videos suffer from a special type of degradation called “moiré pattern”, which is caused by the aliasing between the grid of display screen and the array of camera sensor. However, few works are proposed to tackle this problem. Considering the great success of convolutional neural networks (CNNs) in image restoration, we propose a CNN-based moiré removal method for recaptured screen images. There are mainly two contributions in this paper. First, for the generation of training data, we propose an image registration algorithm via global homography transform and local patch matching to compensate the significant viewpoint disparity between the recaptured screen image and the moiré-free image obtained via screenshot. We construct a moiré removal and brightness improvement (MRBI) database with aligned moiré-free and moiré images. Second, we propose a convolutional neural Network with Additive and Multiplicative modules (termed as AMNet) to transfer the low light moiré image to the bright moiré-free image. The proposed network is trained with pixel-wise loss, perceptual loss, and adversarial loss. Extensive experiments on 340 test images demonstrate that the proposed method outperforms state-of-the-art moiré removal methods. Our database and code will be released after the acceptance of this paper.Keywords
Funding Information
- National Natural Science Foundation of China (61672378, 61771339, 61520106002)
- Elite Scholar Program of Tianjin University, Tianjin, China
This publication has 29 references indexed in Scilit:
- Face-Spoofing 2D-Detection Based on Moiré-Pattern AnalysisIEEE Transactions on Information Forensics and Security, 2015
- An Image Recapture Detection Algorithm Based on Learning Dictionaries of Edge ProfilesIEEE Transactions on Information Forensics and Security, 2015
- Scanned Image Descreening With Image Redundancy and Adaptive FilteringIEEE Transactions on Image Processing, 2014
- A median-Gaussian filtering framework for Moiré pattern noise removal from X-ray microscopy imageMicron, 2012
- Color image demosaicking: An overviewSignal Processing: Image Communication, 2011
- Accelerated Hypothesis Generation for Multi-structure Robust Fitting2010
- Distinctive Image Features from Scale-Invariant KeypointsInternational Journal of Computer Vision, 2004
- Image quality assessment: from error visibility to structural similarityIEEE Transactions on Image Processing, 2004
- Video moire cancellation filter for high-resolution CRTsIEEE Transactions on Consumer Electronics, 2001
- Random Sample Consensus: A Paradigm for Model Fitting with Applications to Image Analysis and Automated Cartography1987