On the Fundamental Limits of Adaptive Sensing
Preprint
Abstract
Suppose we can sequentially acquire arbitrary linear measurements of an n-dimensional vector x resulting in the linear model y = Ax + z, where z represents measurement noise. If the signal is known to be sparse, one would expect the following folk theorem to be true: choosing an adaptive strategy which cleverly selects the next row of A based on what has been previously observed should do far better than a nonadaptive strategy which sets the rows of A ahead of time, thus not trying to learn anything about the signal in between observations. This paper shows that the folk theorem is false. We prove that the advantages offered by clever adaptive strategies and sophisticated estimation procedures---no matter how intractable---over classical compressed acquisition/recovery schemes are, in general, minimal.Keywords
All Related Versions
This publication has 10 references indexed in Scilit:
- How well can we estimate a sparse vector?Applied and Computational Harmonic Analysis, 2013
- Minimax risks for sparse regressions: Ultra-high dimensional phenomenonsElectronic Journal of Statistics, 2012
- Minimax Rates of Estimation for High-Dimensional Linear Regression Over $\ell_q$-BallsIEEE Transactions on Information Theory, 2011
- Information Theoretic Bounds for Compressed SensingIEEE Transactions on Information Theory, 2010
- Minimax Bounds for Active LearningIEEE Transactions on Information Theory, 2008
- The Dantzig selector: Statistical estimation when p is much larger than nThe Annals of Statistics, 2007
- Near-Optimal Signal Recovery From Random Projections: Universal Encoding Strategies?IEEE Transactions on Information Theory, 2006
- Robust uncertainty principles: exact signal reconstruction from highly incomplete frequency informationIEEE Transactions on Information Theory, 2006
- Higher criticism for detecting sparse heterogeneous mixturesThe Annals of Statistics, 2004
- Regression Shrinkage and Selection Via the LassoJournal of the Royal Statistical Society Series B: Statistical Methodology, 1996