A Comprehensive Survey on Computational Aesthetic Evaluation of Visual Art Images: Metrics and Challenges
Top Cited Papers
Open Access
- 24 May 2021
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Access
- Vol. 9, 77164-77187
Abstract
Computational image aesthetic evaluation is a computable human aesthetic perception and judgment realized by machines, which has a significant impact on a variety of applications such as image advanced search and promotional exhibition of painting arts. Various approaches have been proposed in copious literature trying to solve this challenging problem. However, there have been few attempts in reviewing works from different types of visual arts, due to their significant differences in visual features and aesthetic principles. In this survey, we present a comprehensive listing of the reviewed works on aesthetic assessment of photographs and paintings, mainly highlighting the contributions and innovations of the existing approaches. We firstly introduce aesthetic assessment benchmark datasets in different categories. Then, conventional aesthetic evaluation approaches based on handcrafted features are reviewed. Besides, we systematically evaluate recent deep learning techniques that are useful for developing robust models for aesthetic prediction tasks in scoring, distribution, attribute, and description. Moreover, the possibility of aesthetic-aware color enhancement, recomposition of photo images, and automatic generation of aesthetic-guided art paintings through computational approaches are summarized. Finally, challenges and potential future directions for this field are discussed. We hope that our survey could serve as a comprehensive reference source for future research on computational aesthetics in visual media.Keywords
Funding Information
- Natural Science Foundation of Zhejiang Province (LQ20F020022)
- National Natural Science Foundation of China (61772463, 61972458)
This publication has 115 references indexed in Scilit:
- Layered modeling and generation of Pollock’s drip styleThe Visual Computer, 2014
- Beauty in abstract paintings: perceptual contrast and statistical propertiesFrontiers in Human Neuroscience, 2014
- The brain's specialized systems for aesthetic and perceptual judgmentEuropean Journal of Neuroscience, 2013
- Clive Bell’s “Significant Form” and the neurobiology of aestheticsFrontiers in Human Neuroscience, 2013
- Aesthetic photo composition by optimal crop-and-warpComputers & Graphics, 2012
- Visual Cortex in Humans2009
- Photo and Video Quality Evaluation: Focusing on the Subject2008
- Studying Aesthetics in Photographic Images Using a Computational Approach2006
- Image quality assessment: from error visibility to structural similarityIEEE Transactions on Image Processing, 2004
- Neural Correlates of BeautyJournal of Neurophysiology, 2004