An optimized first-order method for image restoration
Authors:
- 1 September 2015
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 3675-3679
Abstract
First-order methods are used widely for large scale optimization problems in signal/image processing and machine learning, because their computation depends mildly on the problem dimension. Nesterov's fast gradient method (FGM) has the optimal convergence rate among first-order methods for smooth convex minimization; its extension to non-smooth case, the fast iterative shrinkage-thresholding algorithm (FISTA), also satisfies the optimal rate; thus both algorithms have gained great interest. We recently introduced a new optimized gradient method (OGM) (for smooth convex functions) having a theoretical convergence speed that is 2× faster than Nesterov's FGM. This paper further discusses the convergence analysis of OGM and explores its fast convergence on an image restoration problem using a smoothed total variation (TV) regularizer. In addition, we empirically investigate the extension of OGM to nonsmooth convex minimization for image restoration with l 1 -sparsity regularization.Keywords
This publication has 9 references indexed in Scilit:
- Performance of first-order methods for smooth convex minimization: a novel approachMathematical Programming, 2013
- A First-Order Primal-Dual Algorithm for Convex Problems with Applications to ImagingJournal of Mathematical Imaging and Vision, 2010
- Fast Gradient-Based Algorithms for Constrained Total Variation Image Denoising and Deblurring ProblemsIEEE Transactions on Image Processing, 2009
- A Fast Iterative Shrinkage-Thresholding Algorithm for Linear Inverse ProblemsSIAM Journal on Imaging Sciences, 2009
- A New TwIST: Two-Step Iterative Shrinkage/Thresholding Algorithms for Image RestorationIEEE Transactions on Image Processing, 2007
- Smooth minimization of non-smooth functionsMathematical Programming, 2004
- An iterative thresholding algorithm for linear inverse problems with a sparsity constraintCommunications on Pure and Applied Mathematics, 2004
- Introductory Lectures on Convex Optimization2004
- Nonlinear total variation based noise removal algorithmsPhysica D: Nonlinear Phenomena, 1992