Geometry, Manifolds, and Nonconvex Optimization: How Geometry Can Help Optimization
- 10 September 2020
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Signal Processing Magazine
- Vol. 37 (5) , 109-119
Abstract
Aimed at both casual spectators and active participants of optimization on manifolds alike, this introductory article presents a wide range of information I would have liked to have been told when I first entered the field. Several arguments are put forth: 1) it is not true that nonconvex implies difficult, 2) many optimization problems in signal processing are approached from the wrong perspective (once-off versus realtime optimization), and 3) the geometry of a manifold should not be used simply for the sake of it. This article also predicts that there is considerable potential for future work on optimization on compact manifolds; large classes of such problems are no harder than convex problems.Keywords
This publication has 21 references indexed in Scilit:
- A framework for generalising the Newton method and other iterative methods from Euclidean space to manifoldsNumerische Mathematik, 2014
- Computing the Karcher mean of symmetric positive definite matricesLinear Algebra and its Applications, 2013
- A feasible method for optimization with orthogonality constraintsMathematical Programming, 2012
- Optimization algorithms exploiting unitary constraintsIEEE Transactions on Signal Processing, 2002
- The Geometry of Algorithms with Orthogonality ConstraintsSIAM Journal on Matrix Analysis and Applications, 1998
- A Dynamical System Approach to Stochastic ApproximationsSIAM Journal on Control and Optimization, 1996
- Lagrange Multipliers and OptimalitySIAM Review, 1993
- Nonconvergence to Unstable Points in Urn Models and Stochastic ApproximationsThe Annals of Probability, 1990
- Minimizing a differentiable function over a differential manifoldJournal of Optimization Theory and Applications, 1982
- Formulae for high derivatives of composite functionsMathematical Proceedings of the Cambridge Philosophical Society, 1978