IC9600: A Benchmark Dataset for Automatic Image Complexity Assessment
- 27 December 2022
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Pattern Analysis and Machine Intelligence
- Vol. PP (01628828) , 1-17
Abstract
Image complexity (IC) is an essential visual perception for human beings to understand an image. However, explicitly evaluating the IC is challenging, and has long been overlooked since, on the one hand, the evaluation of IC is relatively subjective due to its dependence on human perception, and on the other hand, the IC is semantic-dependent while real-world images are diverse. To facilitate the research of IC assessment in this deep learning era, we built the first, to our best knowledge, large-scale IC dataset with 9,600 well-annotated images. The images are of diverse areas such as abstract, paintings and real-world scenes, each of which is elaborately annotated by 17 human contributors. Powered by this high-quality dataset, we further provide a base model to predict the IC scores and estimate the complexity density maps in a weakly supervised way. The model is verified to be effective, and correlates well with human perception (with the Pearson correlation coefficient being 0.949). Last but not the least, we have empirically validated that the exploration of IC can provide auxiliary information and boost the performance of a wide range of computer vision tasks. The dataset and source code can be found at https://github.com/tinglyfeng/IC9600 .Keywords
This publication has 77 references indexed in Scilit:
- Massive Online Crowdsourced Study of Subjective and Objective Picture QualityIEEE Transactions on Image Processing, 2015
- Computerized measures of visual complexityActa Psychologica, 2015
- Natural scene statistics mediate the perception of image complexityVisual Cognition, 2014
- Quantification of interface visual complexity2014
- Visual complexity attenuates emotional processing in psychopathy: Implications for fear-potentiated startle deficitsCognitive, Affective, & Behavioral Neuroscience, 2011
- Predicting beauty: Fractal dimension and visual complexity in artBritish Journal of Psychology, 2011
- The Pascal Visual Object Classes (VOC) ChallengeInternational Journal of Computer Vision, 2009
- Visual complexity of websites: Effects on users’ experience, physiology, performance, and memoryInternational Journal of Human-Computer Studies, 2009
- Measuring visual clutterJournal of Vision, 2007
- Visual complexity: A review.Psychological Bulletin, 2006