Adaptive Learning in Complex Reproducing Kernel Hilbert Spaces Employing Wirtinger's Subgradients
Authors:
- 9 January 2012
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Neural Networks and Learning Systems
- Vol. 23 (3) , 425-438
Abstract
This paper presents a wide framework for non-linear online supervised learning tasks in the context of complex valued signal processing. The (complex) input data are mapped into a complex reproducing kernel Hilbert space (RKHS), where the learning phase is taking place. Both pure complex kernels and real kernels (via the complexification trick) can be employed. Moreover, any convex, continuous and not necessarily differentiable function can be used to measure the loss between the output of the specific system and the desired response. The only requirement is the subgradient of the adopted loss function to be available in an analytic form. In order to derive analytically the subgradients, the principles of the (recently developed) Wirtinger's calculus in complex RKHS are exploited. Furthermore, both linear and widely linear (in RKHS) estimation filters are considered. To cope with the problem of increasing memory requirements, which is present in almost all online schemes in RKHS, the sparsification scheme, based on projection onto closed balls, has been adopted. We demonstrate the effectiveness of the proposed framework in a non-linear channel identification task, a non-linear channel equalization problem and a quadrature phase shift keying equalization scheme, using both circular and non circular synthetic signal sources.Keywords
This publication has 52 references indexed in Scilit:
- The Adaptive Projected Subgradient Method over the Fixed Point Set of Strongly Attracting Nonexpansive MappingsNumerical Functional Analysis and Optimization, 2006
- Kernel methods and their potential use in signal processingIEEE Signal Processing Magazine, 2004
- Online Learning with KernelsIEEE Transactions on Signal Processing, 2004
- The Kernel Recursive Least-Squares AlgorithmIEEE Transactions on Signal Processing, 2004
- Active Set Support Vector RegressionIEEE Transactions on Neural Networks, 2004
- Data-Aided and Blind Stochastic Gradient Algorithms for Widely Linear MMSE MAI Suppression for DS-CDMAIEEE Transactions on Signal Processing, 2004
- Widely linear MMSE equaliser for MIMO linear time-dispersive channelElectronics Letters, 2003
- On circularityIEEE Transactions on Signal Processing, 1994
- Theory of reproducing kernelsTransactions of the American Mathematical Society, 1950
- XVI. Functions of positive and negative type, and their connection the theory of integral equationsPhilosophical Transactions of the Royal Society A, 1909