Scaled memoryless BFGS preconditioned conjugate gradient algorithm for unconstrained optimization
- 10 April 2007
- journal article
- research article
- Published by Taylor & Francis in Optimization Methods and Software
- Vol. 22 (4) , 561-571
Abstract
A scaled memoryless BFGS preconditioned conjugate gradient algorithm for solving unconstrained optimization problems is presented. The basic idea is to combine the scaled memoryless BFGS method and the preconditioning technique in the frame of the conjugate gradient method. The preconditioner, which is also a scaled memoryless BFGS matrix, is reset when the Beale–Powell restart criterion holds. The parameter scaling the gradient is selected as the spectral gradient. In very mild conditions, it is shown that, for strongly convex functions, the algorithm is globally convergent. Computational results for a set consisting of 750 unconstrained optimization test problems show that this new scaled conjugate gradient algorithm substantially outperforms the known conjugate gradient methods including the spectral conjugate gradient by Birgin and Martínez [Birgin, E. and Martínez, J.M., 2001, A spectral conjugate gradient method for unconstrained optimization. Applied Mathematics and Optimization, 43, 117–128], the conjugate gradient by Polak and Ribière [Polak, E. and Ribière, G., 1969, Note sur la convergence de méthodes de directions conjuguées. Revue Francaise Informat. Reserche Opérationnelle, 16, 35–43], as well as the most recent conjugate gradient method with guaranteed descent by Hager and Zhang [Hager, W.W. and Zhang, H., 2005, A new conjugate gradient method with guaranteed descent and an efficient line search. SIAM Journal on Optimization, 16, 170–192; Hager, W.W. and Zhang, H., 2004, CG-DESCENT, A conjugate gradient method with guaranteed descent ACM Transactions on Mathematical Software, 32, 113–137].Keywords
This publication has 18 references indexed in Scilit:
- A New Conjugate Gradient Method with Guaranteed Descent and an Efficient Line SearchSIAM Journal on Optimization, 2005
- Convergence properties of Beale-Powell restart algorithmScience China Mathematics, 1998
- The Barzilai and Borwein Gradient Method for the Large Scale Unconstrained Minimization ProblemSIAM Journal on Optimization, 1997
- CUTEACM Transactions on Mathematical Software, 1995
- On the Convergence of a New Conjugate Gradient AlgorithmSIAM Journal on Numerical Analysis, 1978
- Restart procedures for the conjugate gradient methodMathematical Programming, 1977
- Algorithm 500: Minimization of Unconstrained Multivariate Functions [E4]ACM Transactions on Mathematical Software, 1976
- Convergence Conditions for Ascent Methods. II: Some CorrectionsSIAM Review, 1971
- Convergence Conditions for Ascent MethodsSIAM Review, 1969
- Function minimization by conjugate gradientsThe Computer Journal, 1964