Automatic Reflection Removal using Gradient Intensity and Motion Cues
Authors:
Open Access
- 1 October 2016
- conference paper
- Published by Association for Computing Machinery (ACM)
- p. 466-470
Abstract
We present a method to separate the background image and reflection from two photos that are taken in front of a transparent glass under slightly different viewpoints. In our method, the SIFT-flow between two images is first calculated and a motion hierarchy is constructed from the SIFT-flow at multiple levels of spatial smoothness. To distinguish background edges and reflection edges, we calculate a motion score for each edge pixel by its variance along the motion hierarchy. Alternatively, we make use of the so-called superpixels to group edge pixels into edge segments and calculate the motion scores by averaging over each segment. In the meantime, we also calculate an intensity score for each edge pixel by its gradient magnitude. We combine both motion and intensity scores to get a combination score. A binary labelling (for separation) can be obtained by thresholding the combination scores. The background image is finally reconstructed from the separated gradients. Compared to the existing approaches that require a sequence of images or a video clip for the separation, we only need two images, which largely improves its feasibility. Various challenging examples are tested to validate the effectiveness of our method.Keywords
Funding Information
- National Natural Science Foundation of China (61502079)
This publication has 16 references indexed in Scilit:
- A computational approach for obstruction-free photographyACM Transactions on Graphics, 2015
- Exploiting Reflection Change for Automatic Reflection Removal2013
- High-Quality Reflection Separation Using Polarized ImagesIEEE Transactions on Image Processing, 2011
- Blind Separation of Superimposed Moving Images Using Image StatisticsIEEE Transactions on Pattern Analysis and Machine Intelligence, 2011
- SIFT Flow: Dense Correspondence across Scenes and Its ApplicationsIEEE Transactions on Pattern Analysis and Machine Intelligence, 2010
- User Assisted Separation of Reflections from a Single Image Using a Sparsity PriorIEEE Transactions on Pattern Analysis and Machine Intelligence, 2007
- Removing photography artifacts using gradient projection and flash-exposure samplingACM Transactions on Graphics, 2005
- Efficient Graph-Based Image SegmentationInternational Journal of Computer Vision, 2004
- Layer extraction from multiple images containing reflections and transparency2002
- Separating real and virtual objects from their overlapping images1996