K-SVD Meets Transform Learning: Transform K-SVD
- 28 January 2014
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Signal Processing Letters
- Vol. 21 (3) , 347-351
Abstract
Recently there has been increasing attention directed towards the analysis sparsity models. Consequently, there is a quest for learning the operators which would enable analysis sparse representations for signals in hand. Analysis operator learning algorithms such as the Analysis K-SVD have been proposed. Sparsifying transform learning is a paradigm which is similar to the analysis operator learning, but they differ in some subtle points. In this paper, we propose a novel transform operator learning algorithm called as the Transform K-SVD, which brings the transform learning and the K-SVD based analysis dictionary learning approaches together. The proposed Transform K-SVD has the important advantage that the sparse coding step of the Analysis K-SVD gets replaced with the simple thresholding step of the transform learning framework. We show that the Transform K-SVD learns operators which are similar both in appearance and performance to the operators learned from the Analysis K-SVD, while its computational complexity stays much reduced compared to the Analysis K-SVD.Keywords
This publication has 9 references indexed in Scilit:
- Learning overcomplete sparsifying transforms for signal processing2013
- Constrained Overcomplete Analysis Operator Learning for Cosparse Signal ModellingIEEE Transactions on Signal Processing, 2013
- Analysis Operator Learning and its Application to Image ReconstructionIEEE Transactions on Image Processing, 2013
- Robust Sparse Analysis RegularizationIEEE Transactions on Information Theory, 2012
- Learning Sparsifying TransformsIEEE Transactions on Signal Processing, 2012
- Analysis K-SVD: A Dictionary-Learning Algorithm for the Analysis Sparse ModelIEEE Transactions on Signal Processing, 2012
- Computation- and space-efficient implementation of SSAStatistics and Its Interface, 2010
- Analysis versus synthesis in signal priorsInverse Problems, 2007
- $rm K$-SVD: An Algorithm for Designing Overcomplete Dictionaries for Sparse RepresentationIEEE Transactions on Signal Processing, 2006