Nonlinear Deep Kernel Learning for Image Annotation
Authors:
- 8 February 2017
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Image Processing
- Vol. 26 (4) , 1820-1832
Abstract
Multiple kernel learning (MKL) is a widely used technique for kernel design. Its principle consists in learning, for a given support vector classifier, the most suitable convex (or sparse) linear combination of standard elementary kernels. However, these combinations are shallow and often powerless to capture the actual similarity between highly semantic data, especially for challenging classification tasks, such as image annotation. In this paper, we redefine multiple kernels using deep multi-layer networks. In this new contribution, a deep multiple kernel is recursively defined as a multi-layered combination of nonlinear activation functions, each one involves a combination of several elementary or intermediate kernels, and results into a positive semi-definite deep kernel. We propose four different frameworks in order to learn the weights of these networks: supervised, unsupervised, kernel-based semi-supervised, and Laplacian-based semi-supervised. When plugged into support vector machines, the resulting deep kernel networks show clear gain, compared with several shallow kernels for the task of image annotation. Extensive experiments and analysis on the challenging ImageCLEF photo annotation benchmark, the COREL5k database, and the Banana data set validate the effectiveness of the proposed method.Keywords
Funding Information
- Research Agency Agence Nationale de la Recherche under the MLVIS Project (ANR-11-BS02-0017)
This publication has 39 references indexed in Scilit:
- A review on automatic image annotation techniquesPattern Recognition, 2012
- LIBSVMACM Transactions on Intelligent Systems and Technology, 2011
- Context-Based Support Vector Machines for Interconnected Image Annotation2011
- A survey of content-based image retrieval with high-level semanticsPattern Recognition, 2007
- A Fast Learning Algorithm for Deep Belief NetsNeural Computation, 2006
- Distinctive Image Features from Scale-Invariant KeypointsInternational Journal of Computer Vision, 2004
- An image retrieval system by impression words and specific object names–IRISNeurocomputing, 2002
- Image classification for content-based indexingIEEE Transactions on Image Processing, 2001
- Nonlinear Component Analysis as a Kernel Eigenvalue ProblemNeural Computation, 1998
- Gradient-based learning applied to document recognitionProceedings of the IEEE, 1998