Layer extraction from multiple images containing reflections and transparency
Authors:
- R. SzeliskiRSR. Szeliski
- S. AvidanSAS. Avidan
- P. AnandanPAP. Anandan
Top Cited Papers
- 7 November 2002
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- Vol. 1, 246-253
Abstract
Many natural images contain reflections and transparency, i.e., they contain mixtures of reflected and transmitted light. When viewed from a moving camera, these appear as the su- perposition of component layer images moving relative to each other. The problem of multiple motion recovery has been pre- viously studied by a number of researchers. However, no one has yet demonstrated how to accurately recover the compo- nent images themselves. In this paper we develop an opti- mal approach to recovering layer images and their associated motions from an arbitrary number of composite images. We develop two different techniques for estimating the compo- nent layer images given known motion estimates. The first approach uses constrained least squares to recover the layer images. The second approach iteratively refines lower and upper bounds on the layer images using two novel composit- ing operations, namely minimum- and maximum-composites of aligned images. We combine these layer extraction tech- niques with a dominant motion estimator and a subsequent motion refinement stage. This results in a completely auto- mated system that recovers transparent images and motions from a collection of input images.Keywords
This publication has 16 references indexed in Scilit:
- Accurate computation of optical flow by using layered motion representations2002
- Unified computational theory for motion transparency and motion boundaries based on eigenenergy analysis2002
- A layered approach to stereo reconstruction2002
- Smoothness in layers: Motion segmentation using nonparametric mixture estimation2002
- Separation of Reflection Components Using Color and PolarizationInternational Journal of Computer Vision, 1997
- Skin and bones: multi-layer, locally affine, optical flow and regularization with transparency1996
- Compact representations of videos through dominant and multiple motion estimationIEEE Transactions on Pattern Analysis and Machine Intelligence, 1996
- Computing occluding and transparent motionsInternational Journal of Computer Vision, 1994
- Representing moving images with layersIEEE Transactions on Image Processing, 1994
- Hierarchical model-based motion estimation1992