A Nesterov Type Algorithm with Double Tikhonov Regularization: Fast Convergence of the Function Values and Strong Convergence to the Minimal Norm Solution
Open Access
- 5 July 2024
- journal article
- research article
- Published by Springer Nature in Applied Mathematics & Optimization
- Vol. 90 (1) , 1-29
Abstract
We investigate the strong convergence properties of a Nesterov type algorithm with two Tikhonov regularization terms in connection to the minimization problem of a smooth convex functionf. We show that the generated sequences converge strongly to the minimal norm element from $$\text {argmin}f$$ . We also show fast convergence for the potential energies $$f(x_n)-\text {min}f$$ and $$f(y_n)-\text {min}f$$ , where $$(x_n),\,(y_n)$$ are the sequences generated by our algorithm. Further we obtain fast convergence to zero of the discrete velocity and some estimates concerning the value of the gradient of the objective function in the generated sequences. Via some numerical experiments we show that we need both Tikhonov regularization terms in our algorithm in order to obtain the strong convergence of the generated sequences to the minimum norm minimizer of our objective function.
Keywords
All Related Versions
Funding Information
- Ministerul Cercetării, Inovării şi Digitalizării (PN-III-P1-1.1-TE-2021-0138)
This publication has 24 references indexed in Scilit:
- Convex optimization via inertial algorithms with vanishing Tikhonov regularization: fast convergence to the minimum norm solutionMathematical Methods of Operations Research, 2024
- Accelerated Gradient Methods Combining Tikhonov Regularization with Geometric Damping Driven by the HessianApplied Mathematics & Optimization, 2023
- First-order optimization algorithms via inertial systems with Hessian driven dampingMathematical Programming, 2020
- Convergence rates for an inertial algorithm of gradient type associated to a smooth non-convex minimizationMathematical Programming, 2020
- Tikhonov regularization of a second order dynamical system with Hessian driven dampingMathematical Programming, 2020
- A strongly convergent primal–dual method for nonoverlapping domain decompositionNumerische Mathematik, 2015
- On an asymptotically autonomous system with Tikhonov type regularizing termArchiv der Mathematik, 2010
- Introductory Lectures on Convex Optimization2004
- Asymptotic Control and Stabilization of Nonlinear Oscillators with Non-isolated EquilibriaJournal of Differential Equations, 2002
- A Dynamical Approach to Convex Minimization Coupling Approximation with the Steepest Descent MethodJournal of Differential Equations, 1996