Color multi-fusion fisher vector feature for fine art painting categorization and influence analysis
Authors:
- 1 March 2016
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 1-9
Abstract
This paper presents a novel set of image features that encode the local, color, spatial, relative intensity information and gradient orientation of the painting image for painting artist classification, style classification as well as artist and style influence analysis. In particular, a new color DAISY Fisher vector (CD-FV) feature is first created by computing Fisher vectors on densely sampled DAISY features. Second, a color WLD-SIFT Fisher vector (CWS-FV) feature is developed by fusing Weber local descriptors (WLD) with Scale Invariant Feature Transform (SIFT) descriptors and Fisher vectors are computed on the fused WLD-SIFT features. Finally, an innovative color multi-fusion Fisher vector (CMFFV) feature is developed by integrating the Principal Component Analysis (PCA) features of CD-FV, CWS-FV and color SIFT-FV features. The effectiveness of the proposed CMFFV feature is assessed on the challenging Painting-91 dataset. Experimental results show that the proposed CMFFV feature is able to (i) achieve the state-of-the-art performance for painting artist classification, (ii) outperform other popular image descriptors, as well as (iii) discover the artist and style influence to understand their connections and evolution in different art movement periods.Keywords
This publication has 25 references indexed in Scilit:
- Cross-layer features in convolutional neural networks for generic classification tasks2015
- Extracting discriminative color features for face recognitionPattern Recognition Letters, 2011
- Improving the Fisher Kernel for Large-Scale Image Classification2010
- Classifying paintings by artistic genre: An analysis of features & classifiers2009
- Evaluating Color Descriptors for Object and Scene RecognitionIEEE Transactions on Pattern Analysis and Machine Intelligence, 2009
- Learning Color Names for Real-World ApplicationsIEEE Transactions on Image Processing, 2009
- Fisher Kernels on Visual Vocabularies for Image Categorization2007
- Distinctive Image Features from Scale-Invariant KeypointsInternational Journal of Computer Vision, 2004
- Multiresolution gray-scale and rotation invariant texture classification with local binary patternsIEEE Transactions on Pattern Analysis and Machine Intelligence, 2002
- Modeling the Shape of the Scene: A Holistic Representation of the Spatial EnvelopeInternational Journal of Computer Vision, 2001