Dictionary Subselection Using an Overcomplete Joint Sparsity Model
- 10 July 2014
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Signal Processing
- Vol. 62 (17) , 4547-4556
Abstract
Many natural signals exhibit a sparse representation, whenever a suitable describing model is given. Here, a linear generative model is considered, where many sparsity-based signal processing techniques rely on such a simplified model. As this model is often unknown for many classes of the signals, we need to select such a model based on the domain knowledge or using some exemplar signals. This paper presents a new exemplar based approach for the linear model (called the dictionary) selection, for such sparse inverse problems. The problem of dictionary selection, which has also been called the dictionary learning in this setting, is first reformulated as a joint sparsity model. The joint sparsity model here differs from the standard joint sparsity model as it considers an overcompleteness in the representation of each signal, within the range of selected subspaces. The new dictionary selection paradigm is examined with some synthetic and realistic simulations.Keywords
All Related Versions
Funding Information
- EU FP7, FET-Open (225913)
- EPSRC (EP/J015180/1, EP/K014277/1)
- Scottish Funding Council
- Edinburgh Research Partnership in Engineering and Mathematics
- LABEX WIFI (Laboratory of Excellence within the French Program ¿Investments for the Future¿) (ANR-10-LABX-24 and, ANR-10-IDEX-0001-02 PSL*)
This publication has 20 references indexed in Scilit:
- Dictionary LearningIEEE Signal Processing Magazine, 2011
- Dictionaries for Sparse Representation ModelingProceedings of the IEEE, 2010
- Normalized Iterative Hard Thresholding: Guaranteed Stability and PerformanceIEEE Journal of Selected Topics in Signal Processing, 2010
- Double Sparsity: Learning Sparse Dictionaries for Sparse Signal ApproximationIEEE Transactions on Signal Processing, 2009
- Compressible dictionary learning for fast sparse approximations2009
- Parsimonious dictionary learning2009
- Sparse Approximation Via Iterative Thresholding2006
- Sparse solutions to linear inverse problems with multiple measurement vectorsIEEE Transactions on Signal Processing, 2005
- Uncertainty principles and ideal atomic decompositionIEEE Transactions on Information Theory, 2001
- Sparse coding with an overcomplete basis set: A strategy employed by V1?Vision Research, 1997