A simulation framework for the design and evaluation of computational cameras
- 21 June 2019
- conference paper
- Published by SPIE-Intl Soc Optical Eng
- Vol. 11061, 1106102
Abstract
In the emerging field of computational imaging, rapid prototyping of new camera concepts becomes increasingly difficult since the signal processing is intertwined with the physical design of a camera. As novel computational cameras capture information other than the traditional two-dimensional information, ground truth data, which can be used to thoroughly benchmark a new system design, is also hard to acquire. We propose to bridge this gap by using simulation. In this article, we present a raytracing framework tailored for the design and evaluation of computational imaging systems. We show that, depending on the application, the image formation on a sensor and phenomena like image noise have to be simulated accurately in order to achieve meaningful results while other aspects, such as photorealistic scene modeling, can be omitted. Therefore, we focus on accurately simulating the mandatory components of computational cameras, namely apertures, lenses, spectral filters and sensors. Besides the simulation of the imaging process, the framework is capable of generating various ground truth data, which can be used to evaluate and optimize the performance of a particular imaging system. Due to its modularity, it is easy to further extend the framework to the needs of other fields of application. We make the source code of our simulation framework publicly available and encourage other researchers to use it to design and evaluate their own camera designs.1Keywords
This publication has 14 references indexed in Scilit:
- Tiefenmessung mithilfe einer Kamera mit programmierbarer AperturTM - Technisches Messen, 2017
- Simulationsgestützte Optimierung einer Computational-Kamera zur dichten TiefenschätzungTM - Technisches Messen, 2016
- Imaging With Nature: Compressive Imaging Using a Multiply Scattering MediumScientific Reports, 2014
- When Does Computational Imaging Improve Performance?IEEE Transactions on Image Processing, 2012
- Computational Cameras: Convergence of Optics and ProcessingIEEE Transactions on Image Processing, 2011
- Rendering Wave Effects with Augmented Light FieldComputer Graphics Forum, 2010
- A Simple Method for Ray Tracing Diffraction2003
- Modeling sensor detectability with the VANTAGE geometric/sensor modelerIEEE Transactions on Robotics and Automation, 1991
- Ray tracing with polarization parametersIEEE Computer Graphics and Applications, 1990
- Polarization Ray Tracing1987