Large-Scale Crowdsourced Study for Tone-Mapped HDR Pictures
Open Access
- 8 June 2017
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Image Processing
- Vol. 26 (10) , 4725-4740
Abstract
Measuring digital picture quality, as perceived by human observers, is increasingly important in many applications in which humans are the ultimate consumers of visual information. Standard dynamic range (SDR) images provide 8 b/color/pixel. High dynamic range (HDR) images, usually created from multiple exposures of the same scene, can provide 16 or 32 b/color/pixel, but need to be tonemapped to SDR for display on standard monitors. Multiexposure fusion (MEF) techniques bypass HDR creation by fusing an exposure stack directly to SDR images to achieve aesthetically pleasing luminance and color distributions. Many HDR and MEF databases have a relatively small number of images and human opinion scores, obtained under stringently controlled conditions, thereby limiting realistic viewing. Moreover, many of these databases are intended to compare tone-mapping algorithms, rather than being specialized for developing and comparing image quality assessment models. To overcome these challenges, we conducted a massively crowdsourced online subjective study. The primary contributions described in this paper are: 1) the new ESPL-LIVE HDR Image Database that we created containing diverse images obtained by tonemapping operators and MEF algorithms, with and without postprocessing; 2) a large-scale subjective study that we conducted using a crowdsourced platform to gather more than 300000 opinion scores on 1811 images from over 5000 unique observers; and 3) a detailed study of the correlation performance of the state-ofthe-art no-reference image quality assessment algorithms against human opinion scores of these images. The database is available at http://signal.ece.utexas.edu/%7Edebarati/HDRDatabase.zip.Keywords
Funding Information
- The University of Texas at Austin, Special Research Grant, Vice President for Research
- National Science Foundation (1116656)
This publication has 48 references indexed in Scilit:
- Assessment of video tone-mapping: Are cameras’ S-shaped tone-curves good enough?Journal of Visual Communication and Image Representation, 2013
- LIBSVMACM Transactions on Intelligent Systems and Technology, 2011
- Evaluation of HDR tone‐mapping algorithms using a high‐dynamic‐range display to emulate real scenesJournal of the Society for Information Display, 2010
- Evaluation of HDR tone mapping methods using essential perceptual attributesComputers & Graphics, 2008
- A reality check for tone-mapping operatorsACM Transactions on Applied Perception, 2006
- Analysis of Reproducing Real‐World Appearance on Displays of Varying Dynamic RangeComputer Graphics Forum, 2006
- Evaluation of tone mapping operators using a High Dynamic Range displayACM Transactions on Graphics, 2005
- Perceptual image quality: Effects of tone characteristicsJournal of Electronic Imaging, 2005
- Photographic tone reproduction for digital imagesACM Transactions on Graphics, 2002
- A visibility matching tone reproduction operator for high dynamic range scenesIEEE Transactions on Visualization and Computer Graphics, 1997