Chasing butterflies: In search of efficient dictionaries
Authors:
- 1 April 2015
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- Vol. 54 (15206149) , 3287-3291
Abstract
Dictionary learning aims at finding a frame (called dictionary) in which some training data admits a sparse representation. Traditional dictionary learning is limited to relatively small-scale problems, because high-dimensional dense dictionaries can be costly to manipulate, both at the learning stage and when used for tasks such as sparse coding. In this paper, inspired by usual fast transforms, we consider a multi-layer sparse dictionary structure allowing cheaper manipulation, and propose a learning algorithm imposing this structure. The approach is demonstrated experimentally with a factorization of the Hadamard matrix and on image denoising.Keywords
This publication has 12 references indexed in Scilit:
- $K$-Dimensional Coding Schemes in Hilbert SpacesIEEE Transactions on Information Theory, 2010
- The Sparse Matrix Transform for Covariance Estimation and Analysis of High Dimensional SignalsIEEE Transactions on Image Processing, 2010
- Dictionaries for Sparse Representation ModelingProceedings of the IEEE, 2010
- An algorithm for the rapid evaluation of special function transformsApplied and Computational Harmonic Analysis, 2010
- Double Sparsity: Learning Sparse Dictionaries for Sparse Signal ApproximationIEEE Transactions on Signal Processing, 2009
- Treelets—An adaptive multi-scale basis for sparse unordered dataThe Annals of Applied Statistics, 2008
- $rm K$-SVD: An Algorithm for Designing Overcomplete Dictionaries for Sparse RepresentationIEEE Transactions on Signal Processing, 2006
- Matching pursuits with time-frequency dictionariesIEEE Transactions on Signal Processing, 1993
- A theory for multiresolution signal decomposition: the wavelet representationIEEE Transactions on Pattern Analysis and Machine Intelligence, 1989
- An algorithm for the machine calculation of complex Fourier seriesMathematics of Computation, 1965