Kernel adaptive filtering with maximum correntropy criterion
Authors:
Top Cited Papers
- 1 July 2011
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- No. 21614393,p. 2012-2017
Abstract
Kernel adaptive filters have drawn increasing attention due to their advantages such as universal nonlinear approximation with universal kernels, linearity and convexity in Reproducing Kernel Hilbert Space (RKHS). Among them, the kernel least mean square (KLMS) algorithm deserves particular attention because of its simplicity and sequential learning approach. Similar to most conventional adaptive filtering algorithms, the KLMS adopts the mean square error (MSE) as the adaptation cost. However, the mere second-order statistics is often not suitable for nonlinear and non-Gaussian situations. Therefore, various non-MSE criteria, which involve higher-order statistics, have received an increasing interest. Recently, the correntropy, as an alternative of MSE, has been successfully used in nonlinear and non-Gaussian signal processing and machine learning domains. This fact motivates us in this paper to develop a new kernel adaptive algorithm, called the kernel maximum correntropy (KMC), which combines the advantages of the KLMS and maximum correntropy criterion (MCC). We also study its convergence and self-regularization properties by using the energy conservation relation. The superior performance of the new algorithm has been demonstrated by simulation experiments in the noisy frequency doubling problem.Keywords
This publication has 15 references indexed in Scilit:
- Information theoretic learning with adaptive kernelsSignal Processing, 2011
- A loss function for classification based on a robust similarity metric2010
- Using Correntropy as a cost function in linear adaptive filters2009
- Correntropy as a novel measure for nonlinearity testsSignal Processing, 2009
- Correntropy based Granger causality2008
- Correntropy: Properties and Applications in Non-Gaussian Signal ProcessingIEEE Transactions on Signal Processing, 2007
- The Correntropy Mace Filter for Image Recognition2007 IEEE Workshop on Machine Learning for Signal Processing, 2006
- Generalized correlation function: definition, properties, and application to blind equalizationIEEE Transactions on Signal Processing, 2006
- Regularization Theory and Neural Networks ArchitecturesNeural Computation, 1995
- The Nature of Statistical Learning Theory1995