An adaptive forward-backward-forward splitting algorithm for solving pseudo-monotone inclusions
Preprint
Abstract
In this paper, we propose an adaptive forward-backward-forward splitting algorithm for finding a zero of a pseudo-monotone operator which is split as a sum of three operators: the first is continuous single-valued, the second is Lipschitzian, and the third is maximally monotone. This setting covers, in particular, constrained minimization scenarios, such as problems having smooth and convex functional constraints (e.g., quadratically constrained quadratic programs) or problems with a pseudo-convex objective function minimized over a simple closed convex set (e.g., quadratic over linear fractional programs). For the general problem, we design a forward-backward-forward splitting type method based on novel adaptive stepsize strategies. Under an additional generalized Lipschitz property of the first operator, sublinear convergence rate is derived for the sequence generated by our adaptive algorithm. Moreover, if the sum is uniformly pseudo-monotone, linear/sublinear rates are derived depending on the parameter of uniform pseudo-monotonicity. Preliminary numerical experiments demonstrate the good performance of our method when compared to some existing optimization methods and software.Keywords
All Related Versions
This publication has 26 references indexed in Scilit:
- Bregman Three-Operator Splitting MethodsJournal of Optimization Theory and Applications, 2022
- A distributed algorithm for high-dimension convex quadratically constrained quadratic programsComputational Optimization and Applications, 2021
- On the global convergence rate of the gradient descent method for functions with Hölder continuous gradientsOptimization Letters, 2015
- Universal gradient methods for convex optimization problemsMathematical Programming, 2014
- A Primal–Dual Splitting Method for Convex Optimization Involving Lipschitzian, Proximable and Linear Composite TermsJournal of Optimization Theory and Applications, 2012
- Primal-Dual Splitting Algorithm for Solving Inclusions with Mixtures of Composite, Lipschitzian, and Parallel-Sum Type Monotone OperatorsSet-Valued and Variational Analysis, 2011
- A First-Order Primal-Dual Algorithm for Convex Problems with Applications to ImagingJournal of Mathematical Imaging and Vision, 2010
- Seven kinds of monotone mapsJournal of Optimization Theory and Applications, 1990
- Quasiconvex, pseudoconvex, and strictly pseudoconvex quadratic functionsJournal of Optimization Theory and Applications, 1981
- Convergence theorems for sequences of nonlinear operators in Banach spacesMathematische Zeitschrift, 1967