Kernel Recursive Least-Squares Tracker for Time-Varying Regression
- 28 June 2012
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Neural Networks and Learning Systems
- Vol. 23 (8) , 1313-1326
Abstract
In this paper, we introduce a kernel recursive least-squares (KRLS) algorithm that is able to track nonlinear, time-varying relationships in data. To this purpose, we first derive the standard KRLS equations from a Bayesian perspective (including a sensible approach to pruning) and then take advantage of this framework to incorporate forgetting in a consistent way, thus enabling the algorithm to perform tracking in nonstationary scenarios. The resulting method is the first kernel adaptive filtering algorithm that includes a forgetting factor in a principled and numerically stable manner. In addition to its tracking ability, it has a number of appealing properties. It is online, requires a fixed amount of memory and computation per time step, incorporates regularization in a natural manner and provides confidence intervals along with each prediction. We include experimental results that support the theory as well as illustrate the efficiency of the proposed algorithm.Keywords
This publication has 18 references indexed in Scilit:
- Adaptive Learning in Complex Reproducing Kernel Hilbert Spaces Employing Wirtinger's SubgradientsIEEE Transactions on Neural Networks and Learning Systems, 2012
- A Bayesian approach to tracking with kernel recursive least-squares2011
- Quaternion-Valued Nonlinear Adaptive FilteringIEEE Transactions on Neural Networks, 2011
- Kernel Adaptive Filtering2010
- Extended Kernel Recursive Least Squares AlgorithmIEEE Transactions on Signal Processing, 2009
- A Generalized Growing and Pruning RBF (GGAP-RBF) Neural Network for Function ApproximationIEEE Transactions on Neural Networks, 2005
- Online Learning with KernelsIEEE Transactions on Signal Processing, 2004
- The Kernel Recursive Least-Squares AlgorithmIEEE Transactions on Signal Processing, 2004
- Pruning error minimization in least squares support vector machinesIEEE Transactions on Neural Networks, 2003
- Sparse On-Line Gaussian ProcessesNeural Computation, 2002