A Projection Hestenes–Stiefel Method with Spectral Parameter for Nonlinear Monotone Equations and Signal Processing
Open Access
- 1 May 2020
- journal article
- research article
- Published by MDPI AG in Mathematical and Computational Applications
- Vol. 25 (2) , 27
Abstract
A number of practical problems in science and engineering can be converted into a system of nonlinear equations and therefore, it is imperative to develop efficient methods for solving such equations. Due to their nice convergence properties and low storage requirements, conjugate gradient methods are considered among the most efficient for solving large-scale nonlinear equations. In this paper, a modified conjugate gradient method is proposed based on a projection technique and a suitable line search strategy. The proposed method is matrix-free and its sequence of search directions satisfies sufficient descent condition. Under the assumption that the underlying function is monotone and Lipschitzian continuous, the global convergence of the proposed method is established. The method is applied to solve some benchmark monotone nonlinear equations and also extended to solve -norm regularized problems to reconstruct a sparse signal in compressive sensing. Numerical comparison with some existing methods shows that the proposed method is competitive, efficient and promising.
Keywords
This publication has 47 references indexed in Scilit:
- A Nonlinear Conjugate Gradient Algorithm with an Optimal Property and an Improved Wolfe Line SearchSIAM Journal on Optimization, 2013
- Non-smooth equations based method for -norm problems with applications to compressed sensingNonlinear Analysis, 2011
- An alternating direction method for linear‐constrained matrix nuclear norm minimizationNumerical Linear Algebra with Applications, 2011
- A globally convergent derivative-free method for solving large-scale nonlinear monotone equationsJournal of Computational and Applied Mathematics, 2010
- A coordinate gradient descent method for ℓ 1-regularized convex minimizationComputational Optimization and Applications, 2009
- Spectral gradient projection method for solving nonlinear monotone equationsJournal of Computational and Applied Mathematics, 2006
- An iterative thresholding algorithm for linear inverse problems with a sparsity constraintCommunications on Pure and Applied Mathematics, 2004
- An EM algorithm for wavelet-based image restorationIEEE Transactions on Image Processing, 2003
- Benchmarking optimization software with performance profilesMathematical Programming, 2002
- Newton-type Methods with Generalized Distances For Constrained OptimizationOptimization, 1997