Nonparametric Basis Pursuit via Sparse Kernel-Based Learning: A Unifying View with Advances in Blind Methods
- 12 June 2013
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Signal Processing Magazine
- Vol. 30 (4) , 112-125
Abstract
Signal processing tasks as fundamental as sampling, reconstruction, minimum mean-square error interpolation, and prediction can be viewed under the prism of reproducing kernel Hilbert spaces (RKHSs). Endowing this vantage point with contemporary advances in sparsity-aware modeling and processing promotes the nonparametric basis pursuit advocated in this article as the overarching framework for the confluence of kernel-based learning (KBL) approaches leveraging sparse linear regression, nuclear-norm regularization, and dictionary learning. The novel sparse KBL toolbox goes beyond translating sparse parametric approaches to their nonparametric counterparts to incorporate new possibilities such as multikernel selection and matrix smoothing. The impact of sparse KBL to signal processing applications is illustrated through test cases from cognitive radio sensing, microarray data imputation, and network traffic prediction.Keywords
This publication has 22 references indexed in Scilit:
- Day-ahead electricity market forecasting using kernels2013
- Dictionary Learning for Noisy and Incomplete Hyperspectral ImagesSIAM Journal on Imaging Sciences, 2012
- Sparse Signal Recovery With Temporally Correlated Source Vectors Using Sparse Bayesian LearningIEEE Journal of Selected Topics in Signal Processing, 2011
- Dictionary Identification—Sparse Matrix-Factorization via $\ell_1$-MinimizationIEEE Transactions on Information Theory, 2010
- The Elements of Statistical Learning2009
- A coordinate gradient descent method for nonsmooth separable minimizationMathematical Programming, 2007
- Kernel Matching PursuitMachine Learning, 2002
- Splines: a perfect fit for signal and image processingIEEE Signal Processing Magazine, 1999
- An Equivalence Between Sparse Approximation and Support Vector MachinesNeural Computation, 1998
- Splines minimizing rotation-invariant semi-norms in Sobolev spaces1977