Newton-Step-Based Hard Thresholding Algorithms for Sparse Signal Recovery
Preprint
Abstract
Sparse signal recovery or compressed sensing can be formulated as certain sparse optimization problems. The classic optimization theory indicates that the Newton-like method often has a numerical advantage over the gradient method for nonlinear optimization problems. In this paper, we propose the so-called Newton-step-based iterative hard thresholding (NSIHT) and the Newton-step-based hard thresholding pursuit (NSHTP) algorithms for sparse signal recovery and signal approximation. Different from the traditional iterative hard thresholding (IHT) and hard thresholding pursuit (HTP), the proposed algorithms adopts the Newton-like search direction instead of the steepest descent direction. A theoretical analysis for the proposed algorithms is carried out, and some sufficient conditions for the guaranteed success of sparse signal recovery via these algorithms are established. Our results are shown under the restricted isometry property which is one of the standard assumptions widely used in the field of compressed sensing and signal approximation. The empirical results obtained from synthetic data recovery indicate that the proposed algorithms are efficient signal recovery methods. The numerical stability of our algorithms in terms of the residual reduction is also investigated through simulations.Keywords
All Related Versions
This publication has 23 references indexed in Scilit:
- Analysis of optimal thresholding algorithms for compressed sensingSignal Processing, 2021
- Block normalised iterative hard thresholding algorithm for compressed sensingElectronics Letters, 2019
- Iterative hard thresholding for low-rank recovery from rank-one projectionsLinear Algebra and its Applications, 2019
- A Mathematical Introduction to Compressive Sensing2013
- Sparse Representations, Compressive Sensing and dictionaries for pattern recognition2011
- Sparse Recovery Algorithms: Sufficient Conditions in Terms of Restricted Isometry Constants2011
- Normalized Iterative Hard Thresholding: Guaranteed Stability and PerformanceIEEE Journal of Selected Topics in Signal Processing, 2010
- Iterative hard thresholding for compressed sensingApplied and Computational Harmonic Analysis, 2009
- Enhancing Sparsity by Reweighted ℓ 1 MinimizationJournal of Fourier Analysis and Applications, 2008
- Iterative Thresholding for Sparse ApproximationsJournal of Fourier Analysis and Applications, 2008