Complex Support Vector Machines for Regression and Quaternary Classification
Authors:
- 30 July 2014
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Neural Networks and Learning Systems
- Vol. 26 (6) , 1260-1274
Abstract
The paper presents a new framework for complex support vector regression (SVR) as well as Support Vector Machines (SVM) for quaternary classification. The method exploits the notion of widely linear estimation to model the input-out relation for complex-valued data and considers two cases: 1) the complex data are split into their real and imaginary parts and a typical real kernel is employed to map the complex data to a complexified feature space and 2) a pure complex kernel is used to directly map the data to the induced complex feature space. The recently developed Wirtinger's calculus on complex reproducing kernel Hilbert spaces is employed to compute the Lagrangian and derive the dual optimization problem. As one of our major results, we prove that any complex SVM/SVR task is equivalent with solving two real SVM/SVR tasks exploiting a specific real kernel, which is generated by the chosen complex kernel. In particular, the case of pure complex kernels leads to the generation of new kernels, which have not been considered before. In the classification case, the proposed framework inherently splits the complex space into four parts. This leads naturally to solving the four class-task (quaternary classification), instead of the typical two classes of the real SVM. In turn, this rationale can be used in a multiclass problem as a split-class scenario based on four classes, as opposed to the one-versus-all method; this can lead to significant computational savings. Experiments demonstrate the effectiveness of the proposed framework for regression and classification tasks that involve complex data.Keywords
All Related Versions
Funding Information
- European Union, European Social Fund
- Greek National Funds through the Operational Program Education and Lifelong Learning, National Strategic Reference Framework-Research Funding Program: Aristeia (I: 621)
This publication has 40 references indexed in Scilit:
- Complex‐Valued Adaptive Signal Processing2010
- SVM Multiregression for Nonlinear Channel Estimation in Multiple-Input Multiple-Output SystemsIEEE Transactions on Signal Processing, 2004
- Online Learning with KernelsIEEE Transactions on Signal Processing, 2004
- The Kernel Recursive Least-Squares AlgorithmIEEE Transactions on Signal Processing, 2004
- An introduction to kernel-based learning algorithmsIEEE Transactions on Neural Networks, 2001
- Support vector machine techniques for nonlinear equalizationIEEE Transactions on Signal Processing, 2000
- Gradient-based learning applied to document recognitionProceedings of the IEEE, 1998
- Second-order statistics of complex signalsIEEE Transactions on Signal Processing, 1997
- On circularityIEEE Transactions on Signal Processing, 1994
- Theory of reproducing kernelsTransactions of the American Mathematical Society, 1950