A structured RMIL conjugate gradient-based strategy for nonlinear least squares with applications in image restoration problems
Authors:
- Rabiu Bashir YunusRYRabiu Bashir Yunus
- Ahmed R. El-SaeedAEAhmed R. El-Saeed
- Nooraini ZainuddinNZNooraini Zainuddin
Open Access
- 1 January 2025
- journal article
- Published by American Institute of Mathematical Sciences (AIMS) in AIMS Mathematics
- Vol. 10 (6) , 14893-14916
Abstract
Numerous scientific and technical domains have found use for nonlinear least squares (NLS). Conventional approaches to NLS problem solving often suffer from computational inefficiencies and high memory requirements, particularly when applied to large-scale systems. This paper presents the structured conjugate gradient coefficient using a structured secant-like approximation to solve NLS problems. The approach develops a structured vector approximation that captures the vector-matrix relationship using Taylor series expansions of the Hessian of the goal function. It is possible to incorporate more Hessian information into the traditional search direction, since this approximation satisfies a quasi-Newton condition. Furthermore, given conventional assumptions, a global convergence study is performed. Benchmark NLS tasks are used for numerical studies to assess the method's performance against alternative approaches. The results demonstrate the promise and success of the approach. Lastly, problems with image restoration are addressed using the suggested technique.Keywords
This publication has 38 references indexed in Scilit:
- A new family of hybrid three-term conjugate gradient methods with applications in image restorationNumerical Algorithms, 2022
- Jacobian-Free Implicit Inner-Iteration Preconditioner for Nonlinear Least Squares ProblemsJournal of Scientific Computing, 2016
- A note about WYL’s conjugate gradient method and its applicationsApplied Mathematics and Computation, 2007
- Minimization of an Edge-Preserving Regularization Functional by Conjugate Gradient Type Methods2007
- A Modified Quasi-Newton Method for Structured Optimization with Partial Information on the HessianComputational Optimization and Applications, 2006
- Benchmarking optimization software with performance profilesMathematical Programming, 2002
- Efficient generalized conjugate gradient algorithms, part 1: TheoryJournal of Optimization Theory and Applications, 1991
- Convergence theory for the structured BFGS secant method with an application to nonlinear least squaresJournal of Optimization Theory and Applications, 1989
- Methods of accessing by attributes in a random-access memoryCybernetics and Systems Analysis, 1969
- The conjugate gradient method in extremal problemsUSSR Computational Mathematics and Mathematical Physics, 1969