Raw or Cooked? Object Detection on RAW Images
Preprint
Abstract
Images fed to a deep neural network have in general undergone several handcrafted image signal processing (ISP) operations, all of which have been optimized to produce visually pleasing images. In this work, we investigate the hypothesis that the intermediate representation of visually pleasing images is sub-optimal for downstream computer vision tasks compared to the RAW image representation. We suggest that the operations of the ISP instead should be optimized towards the end task, by learning the parameters of the operations jointly during training. We extend previous works on this topic and propose a new learnable operation that enables an object detector to achieve superior performance when compared to both previous works and traditional RGB images. In experiments on the open PASCALRAW dataset, we empirically confirm our hypothesis.Keywords
All Related Versions
This publication has 12 references indexed in Scilit:
- DynamicISP: Dynamically Controlled Image Signal Processor for Image Recognition2023
- Rawgment: Noise-Accounted RAW Augmentation Enables Recognition in a Wide Variety of Environments2023
- A Raw Image-Based End-to-End Object Detection Accelerator Using HOG FeaturesIEEE Transactions on Circuits and Systems I: Regular Papers, 2021
- Mathematical prediction of the time evolution of the COVID-19 pandemic in Italy by a Gauss error function and Monte Carlo simulationsThe European Physical Journal Plus, 2020
- Faster R-CNN: Towards Real-Time Object Detection with Region Proposal NetworksIEEE Transactions on Pattern Analysis and Machine Intelligence, 2016
- Microsoft COCO: Common Objects in Context2014
- Practical Poissonian-Gaussian Noise Modeling and Fitting for Single-Image Raw-DataIEEE Transactions on Image Processing, 2008
- Lightness Perception in Tone Reproduction for High Dynamic Range ImagesComputer Graphics Forum, 2005
- Adaptive homogeneity-directed demosaicing algorithmIEEE Transactions on Image Processing, 2005
- A new family of power transformations to improve normality or symmetryBiometrika, 2000