An analysis of color demosaicing in plenoptic cameras
Authors:
- 1 June 2012
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- No. 10636919,p. 901-908
Abstract
A plenoptic camera captures the 4D radiance about a scene. Recent practical solutions mount a microlens array on top of a commodity SLR to directly acquire these rays. However, they suffer from low resolution as hundreds of thousands of views need to be captured in a single shot. In this paper, we develop a simple but effective technique for improving the image resolution of the plenoptic camera by maneuvering the demosaicing process. We first show that the traditional solution by demosaicing each individual microlens image and then blending them for view synthesis is suboptimal. In particular, this demosaicing process often suffers from aliasing artifacts, and it damages high frequency information recorded by each microlens image hence degrades the image quality. We instead propose to de-mosaic the synthesized view at the rendering stage. Specifically, we first transform the radiance to the desired focal plane and then apply frequency domain plenoptic resampling. A full resolution color filtered image is then created by performing a 2D integral projection from the reparam-eterized radiance. Finally, we conduct demosacing to obtain the color result. We show that our solution can achieve visible resolution enhancement on dynamic refocusing and depth-assisted deep focus rendering.Keywords
This publication has 16 references indexed in Scilit:
- The focused plenoptic camera2009
- Adaptive Filtering for Color Filter Array DemosaickingIEEE Transactions on Image Processing, 2007
- Linear demosaicing inspired by the human visual systemIEEE Transactions on Image Processing, 2005
- Demosaicing using optimal recoveryIEEE Transactions on Image Processing, 2005
- Color filter array demosaicking: New method and performance measuresIEEE Transactions on Image Processing, 2003
- Adaptive demosaicing with the principal vector methodIEEE Transactions on Consumer Electronics, 2002
- New edge-directed interpolationIEEE Transactions on Image Processing, 2001
- Dynamically reparameterized light fields2000
- The lumigraph1996
- Light field rendering1996