Semi‐supervised multiple empirical kernel learning with pseudo empirical loss and similarity regularization
- 29 September 2021
- journal article
- research article
- Published by Hindawi Limited in International Journal of Intelligent Systems
- Vol. 37 (2) , 1674-1696
Abstract
Multiple empirical kernel learning (MEKL) is a scalable and efficient supervised algorithm based on labeled samples. However, there is still a huge amount of unlabeled samples in the real-world application, which are not applicable for the supervised algorithm. To fully utilize the spatial distribution information of the unlabeled samples, this paper proposes a novel semi-supervised multiple empirical kernel learning (SSMEKL). SSMEKL enables multiple empirical kernel learning to achieve better classification performance with a small number of labeled samples and a large number of unlabeled samples. First, SSMEKL uses the collaborative information of multiple kernels to provide a pseudo labels to some unlabeled samples in the optimization process of the model, and SSMEKL designs pseudo-empirical loss to transform learning process of the unlabeled samples into supervised learning. Second, SSMEKL designs the similarity regularization for unlabeled samples to make full use of the spatial information of unlabeled samples. It is required that the output of unlabeled samples should be similar to the neighboring labeled samples to improve the classification performance of the model. The proposed SSMEKL can improve the performance of the classifier by using a small number of labeled samples and numerous unlabeled samples to improve the classification performance of MEKL. In the experiment, the results on four real-world data sets and two multiview data sets validate the effectiveness and superiority of the proposed SSMEKL.Keywords
Funding Information
- National Natural Science Foundation of China (62076094, 61806078, 61725301)
- Science and Technology Commission of Shanghai Municipality (20511100600, 21511100800)
This publication has 48 references indexed in Scilit:
- EasyMKL: a scalable multiple kernel learning algorithmNeurocomputing, 2015
- A Scalable Unsupervised Feature Merging Approach to Efficient Dimensionality Reduction of High-Dimensional Visual Data2013
- Analysing the classification of imbalanced data-sets with multiple classes: Binarization techniques and ad-hoc approachesKnowledge-Based Systems, 2013
- Heterogeneous Face Recognition Using Kernel Prototype SimilaritiesIEEE Transactions on Pattern Analysis and Machine Intelligence, 2012
- DEAP: A Database for Emotion Analysis ;Using Physiological SignalsIEEE Transactions on Affective Computing, 2011
- LIBSVMACM Transactions on Intelligent Systems and Technology, 2011
- Estimation of prediction error by using K-fold cross-validationStatistics and Computing, 2009
- Semi-Supervised Learning (Chapelle, O. et al., Eds.; 2006) [Book reviews]IEEE Transactions on Neural Networks, 2009
- MultiK-MHKS: A Novel Multiple Kernel Learning AlgorithmIEEE Transactions on Pattern Analysis and Machine Intelligence, 2007
- Comparing support vector machines with Gaussian kernels to radial basis function classifiersIEEE Transactions on Signal Processing, 1997