Perceptual Quality Assessment of Smartphone Photography
Authors:
Top Cited Papers
- 1 June 2020
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 3674-3683
Abstract
As smartphones become people’s primary cameras to take photos, the quality of their cameras and the associated computational photography modules has become a de facto standard in evaluating and ranking smartphones in the consumer market. We conduct so far the most comprehensive study of perceptual quality assessment of smartphone photography. We introduce the Smartphone Photography Attribute and Quality (SPAQ) database, consisting of 11,125 pictures taken by 66 smartphones, where each image is attached with so far the richest annotations. Specifically, we collect a series of human opinions for each image, including image quality, image attributes (brightness, colorfulness, contrast, noisiness, and sharpness), and scene category labels (animal, cityscape, human, indoor scene, landscape, night scene, plant, still life, and others) in a well-controlled laboratory environment. The exchangeable image file format (EXIF) data for all images are also recorded to aid deeper analysis. We also make the first attempts using the database to train blind image quality assessment (BIQA) models constructed by baseline and multi-task deep neural networks. The results provide useful insights on how EXIF data, image attributes and high-level semantics interact with image quality, how next-generation BIQA models can be designed, and how better computational photography systems can be optimized on mobile devices. The database along with the proposed BIQA models are available at https://github.com/h4nwei/SPAQ.Keywords
This publication has 33 references indexed in Scilit:
- A Feature-Enriched Completely Blind Image Quality EvaluatorIEEE Transactions on Image Processing, 2015
- ImageNet Large Scale Visual Recognition ChallengeInternational Journal of Computer Vision, 2015
- Image database TID2013: Peculiarities, results and perspectivesSignal Processing: Image Communication, 2015
- CID2013: A Database for Evaluating No-Reference Image Quality Assessment AlgorithmsIEEE Transactions on Image Processing, 2014
- No-Reference Quality Assessment of Contrast-Distorted Images Based on Natural Scene StatisticsIEEE Signal Processing Letters, 2014
- Learning without Human Scores for Blind Image Quality Assessment2013
- Definitions of dataset in the scientific and technical literatureProceedings of the American Society for Information Science and Technology, 2010
- Modern Image Quality AssessmentSynthesis Lectures on Image, Video, and Multimedia Processing, 2006
- Image quality assessment: from error visibility to structural similarityIEEE Transactions on Image Processing, 2004
- Visible differences predictor: an algorithm for the assessment of image fidelity1992