A General Inertial Proximal Point Algorithm for Mixed Variational Inequality Problem
Authors:
- Caihua ChenCCCaihua Chen
- Shiqian MaSMShiqian Ma
- Junfeng YangJYJunfeng Yang
- 1 January 2015
- journal article
- research article
- Published by Society for Industrial & Applied Mathematics (SIAM) in SIAM Journal on Optimization
- Vol. 25 (4) , 2120-2142
Abstract
In this paper, we first propose a general inertial proximal point algorithm (PPA) for the mixed variational inequality (VI) problem. Based on our knowledge, without stronger assumptions, a convergence rate result is not known in the literature for inertial type PPAs. Under certain conditions, we are able to establish the global convergence and nonasymptotic $O(1/k)$ convergence rate result (under a certain measure) of the proposed general inertial PPA. We then show that both the linearized augmented Lagrangian method (ALM) and the linearized alternating direction method of multipliers (ADMM) for structured convex optimization are applications of a general PPA, provided that the algorithmic parameters are properly chosen. Consequently, global convergence and convergence rate results of the linearized ALM and ADMM follow directly from results existing in the literature. In particular, by applying the proposed inertial PPA for mixed VI to structured convex optimization, we obtain inertial versions of the lin...
Keywords
All Related Versions
This publication has 31 references indexed in Scilit:
- A Generalized Proximal Point Algorithm and Its Convergence RateSIAM Journal on Optimization, 2014
- A Dynamical Approach to an Inertial Forward-Backward Algorithm for Convex MinimizationSIAM Journal on Optimization, 2014
- A proximal point algorithm revisit on the alternating direction method of multipliersScience China Mathematics, 2013
- Distributed Optimization and Statistical Learning via the Alternating Direction Method of MultipliersFoundations and Trends in Machine Learning, 2011
- A Fast Iterative Shrinkage-Thresholding Algorithm for Linear Inverse ProblemsSIAM Journal on Imaging Sciences, 2009
- Weak Convergence of a Relaxed and Inertial Hybrid Projection-Proximal Point Algorithm for Maximal Monotone Operators in Hilbert SpaceSIAM Journal on Optimization, 2004
- An Inertial Proximal Method for Maximal Monotone Operators via Discretization of a Nonlinear Oscillator with DampingSet-Valued Analysis, 2001
- On the Minimizing Property of a Second Order Dissipative System in Hilbert SpacesSIAM Journal on Control and Optimization, 2000
- Algorithm 617: DAFNE: a differential-equations algorithm for nonlinear equationsACM Transactions on Mathematical Software, 1984
- Asymptotic convergence of nonlinear contraction semigroups in Hilbert spaceJournal of Functional Analysis, 1975