Minimizing Convex Functions with Rational Minimizers
Author:
Open Access
- 19 December 2022
- journal article
- research article
- Published by Association for Computing Machinery (ACM) in Journal of the ACM
- Vol. 70 (1) , 1-27
Abstract
Given a separation oracle SO for a convex function f defined on ℝ n that has an integral minimizer inside a box with radius R , we show how to find an exact minimizer of f using at most O(n (n log log (n)/ log (n) + log ( R ))) calls to SO and poly ( n , log ( R )) arithmetic operations, or O(n log (nR) calls to SO and exp ( O(n) ) ⋅ poly (log (R) ) arithmetic operations. When the set of minimizers of f has integral extreme points, our algorithm outputs an integral minimizer of f . This improves upon the previously best oracle complexity of O(n 2 ( n + log ( R ))) for polynomial time algorithms and O(n 2 log ( nR ) for exponential time algorithms obtained by [Grötschel, Lovász and Schrijver, Prog. Comb. Opt. 1984, Springer 1988] over thirty years ago. Our improvement on Grötschel, Lovász and Schrijver’s result generalizes to the setting where the set of minimizers of f is a rational polyhedron with bounded vertex complexity. For the Submodular Function Minimization problem, our result immediately implies a strongly polynomial algorithm that makes at most O(n 3 log log ( n )/log ( n )) calls to an evaluation oracle, and an exponential time algorithm that makes at most O(n 2 log ( n )) calls to an evaluation oracle. These improve upon the previously best O(n 3 log 2 ( n )) oracle complexity for strongly polynomial algorithms given in [Lee, Sidford and Wong, FOCS 2015] and [Dadush, Végh and Zambelli, SODA 2018], and an exponential time algorithm with oracle complexity O(n 3 log ( n )) given in the former work. Our result is achieved via a reduction to the Shortest Vector Problem in lattices. We show how an approximately shortest vector of an auxiliary lattice can be used to effectively reduce the dimension of the problem. Our analysis of the oracle complexity is based on a potential function that simultaneously captures the size of the search set and the density of the lattice, which we analyze via tools from convex geometry and lattice theory.Keywords
Funding Information
- NSF (CCF-1749609, DMS-1839116 and DMS-2023166)
This publication has 33 references indexed in Scilit:
- Covariance estimation for distributions with ${2+\varepsilon}$ momentsThe Annals of Probability, 2013
- Quantitative estimates of the convergence of the empirical covariance matrix in log-concave ensemblesJournal of the American Mathematical Society, 2009
- A faster strongly polynomial time algorithm for submodular function minimizationMathematical Programming, 2007
- Solving convex programs by random walksJournal of the ACM, 2004
- A push-relabel framework for submodular function minimization and applications to parametric optimizationDiscrete Applied Mathematics, 2003
- A note on Schrijver's submodular function minimization algorithmJournal of Combinatorial Theory, Series B, 2002
- A combinatorial strongly polynomial algorithm for minimizing submodular functionsJournal of the ACM, 2001
- A Combinatorial Algorithm Minimizing Submodular Functions in Strongly Polynomial TimeJournal of Combinatorial Theory, Series B, 2000
- Polynomial algorithms in linear programmingUSSR Computational Mathematics and Mathematical Physics, 1980
- Location of the Maximum on Unimodal SurfacesJournal of the ACM, 1965