An Improved Boosted DC Algorithm for Nonsmooth Functions with Applications in Image Recovery
Authors:
- ZeYu LiZLZeYu Li
- Te QiTQTe Qi
- TieYong ZengTZTieYong Zeng
Preprint
Abstract
We propose a new approach to perform the boosted difference of convex functions algorithm (BDCA) on non-smooth and non-convex problems involving the difference of convex (DC) functions. The recently proposed BDCA uses an extrapolation step from the point computed by the classical DC algorithm (DCA) via a line search procedure in a descent direction to get an additional decrease of the objective function and accelerate the convergence of DCA. However, when the first function in DC decomposition is non-smooth, the direction computed by BDCA can be ascent and a monotone line search cannot be performed. In this work, we proposed a monotone improved boosted difference of convex functions algorithm (IBDCA) for certain types of non-smooth DC programs, namely those that can be formulated as the difference of a possibly non-smooth function and a smooth one. We show that any cluster point of the sequence generated by IBDCA is a critical point of the problem under consideration and that the corresponding objective value is monotonically decreasing and convergent. We also present the global convergence and the convergent rate under the Kurdyka-Lojasiewicz property. The applications of IBDCA in image recovery show the effectiveness of our proposed method. The corresponding numerical experiments demonstrate that our IBDCA outperforms DCA and other state-of-the-art DC methods in both computational time and number of iterations.Keywords
All Related Versions
This publication has 39 references indexed in Scilit:
- A boosted DC algorithm for non-differentiable DC components with non-monotone line searchComputational Optimization and Applications, 2024
- An augmented subgradient method for minimizing nonsmooth DC functionsComputational Optimization and Applications, 2021
- DC programming and DCA: thirty years of developmentsMathematical Programming, 2018
- DC formulations and algorithms for sparse optimization problemsMathematical Programming, 2017
- Accelerating the DC algorithm for smooth functionsMathematical Programming, 2017
- Poisson Noise Reduction with Non-local PCAJournal of Mathematical Imaging and Vision, 2013
- Convergence of descent methods for semi-algebraic and tame problems: proximal algorithms, forward–backward splitting, and regularized Gauss–Seidel methodsMathematical Programming, 2011
- A First-Order Primal-Dual Algorithm for Convex Problems with Applications to ImagingJournal of Mathematical Imaging and Vision, 2010
- On the convergence of the proximal algorithm for nonsmooth functions involving analytic featuresMathematical Programming, 2007
- A minimization method for the sum of a convex function and a continuously differentiable functionJournal of Optimization Theory and Applications, 1981