Compressive Sensing on Manifolds Using a Nonparametric Mixture of Factor Analyzers: Algorithm and Performance Bounds
Authors:
- 30 August 2010
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Signal Processing
- Vol. 58 (12) , 6140-6155
Abstract
Nonparametric Bayesian methods are employed to constitute a mixture of low-rank Gaussians, for data x ∈ R N that are of high dimension N but are constrained to reside in a low-dimensional subregion of R N . The number of mixture components and their rank are inferred automatically from the data. The resulting algorithm can be used for learning manifolds and for reconstructing signals from manifolds, based on compressive sensing (CS) projection measurements. The statistical CS inversion is performed analytically. We derive the required number of CS random measurements needed for successful reconstruction, based on easily-computed quantities, drawing on block-sparsity properties. The proposed methodology is validated on several synthetic and real datasets.Keywords
This publication has 25 references indexed in Scilit:
- Exploiting Structure in Wavelet-Based Bayesian Compressive SensingIEEE Transactions on Signal Processing, 2009
- Sampling Theorems for Signals From the Union of Finite-Dimensional Linear SubspacesIEEE Transactions on Information Theory, 2009
- Compressed Sensing and Redundant DictionariesIEEE Transactions on Information Theory, 2008
- Finding the Homology of Submanifolds with High Confidence from Random SamplesDiscrete & Computational Geometry, 2008
- A Simple Proof of the Restricted Isometry Property for Random MatricesConstructive Approximation, 2008
- Fast Transformation-Invariant Component AnalysisInternational Journal of Computer Vision, 2007
- On sparse reconstruction from Fourier and Gaussian measurementsCommunications on Pure and Applied Mathematics, 2007
- Greed is Good: Algorithmic Results for Sparse ApproximationIEEE Transactions on Information Theory, 2004
- Bayesian Analysis of Mixtures of Factor AnalyzersNeural Computation, 2001
- Modeling the manifolds of images of handwritten digitsIEEE Transactions on Neural Networks, 1997