Clifford Support Vector Machines for Classification, Regression, and Recurrence
- 27 September 2010
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Neural Networks
- Vol. 21 (11) , 1731-1746
Abstract
This paper introduces the Clifford support vector machines (CSVM) as a generalization of the real and complex-valued support vector machines using the Clifford geometric algebra. In this framework, we handle the design of kernels involving the Clifford or geometric product. In this approach, one redefines the optimization variables as multivectors. This allows us to have a multivector as output. Therefore, we can represent multiple classes according to the dimension of the geometric algebra in which we work. We show that one can apply CSVM for classification and regression and also to build a recurrent CSVM. The CSVM is an attractive approach for the multiple input multiple output processing of high-dimensional geometric entities. We carried out comparisons between CSVM and the current approaches to solve multiclass classification and regression. We also study the performance of the recurrent CSVM with experiments involving time series. The authors believe that this paper can be of great use for researchers and practitioners interested in multiclass hypercomplex computing, particularly for applications in complex and quaternion signal and image processing, satellite control, neurocomputation, pattern recognition, computer vision, augmented virtual reality, robotics, and humanoids.Keywords
This publication has 16 references indexed in Scilit:
- Harnessing Nonlinearity: Predicting Chaotic Systems and Saving Energy in Wireless CommunicationScience, 2004
- Multicategory Support Vector MachinesJournal of the American Statistical Association, 2004
- Support vector machine learning for interdependent and structured output spaces2004
- Comparison of classifier methods: a case study in handwritten digit recognition2002
- A comparison of methods for multiclass support vector machinesIEEE Transactions on Neural Networks, 2002
- Geometric neural computingIEEE Transactions on Neural Networks, 2001
- An introduction to kernel-based learning algorithmsIEEE Transactions on Neural Networks, 2001
- Recurrent least squares support vector machinesIEEE Transactions on Circuits and Systems I: Regular Papers, 2000
- 10.1162/153244302760200687Applied Physics Letters, 2000
- Single-layer learning revisited: a stepwise procedure for building and training a neural network1990