Polar Alignment and Atomic Decomposition
Preprint
Abstract
Structured optimization uses a prescribed set of atoms to assemble a solution that fits a model to data. Polarity, which extends the familiar notion of orthogonality from linear sets to general convex sets, plays a special role in a simple and geometric form of convex duality. This duality correspondence yields a general notion of alignment that leads to an intuitive and complete description of how atoms participate in the final decomposition of the solution. The resulting geometric perspective leads to variations of existing algorithms effective for large-scale problems. We illustrate these ideas with many examples, including applications in matrix completion and morphological component analysis for the separation of mixtures of signals.Keywords
All Related Versions
This publication has 18 references indexed in Scilit:
- A Two-Stage Active-Set Algorithm for Bound-Constrained OptimizationJournal of Optimization Theory and Applications, 2016
- Forward–Backward Greedy Algorithms for Atomic Norm RegularizationIEEE Transactions on Signal Processing, 2015
- The Convex Geometry of Linear Inverse ProblemsFoundations of Computational Mathematics, 2012
- Sparse Solution of Underdetermined Systems of Linear Equations by Stagewise Orthogonal Matching PursuitIEEE Transactions on Information Theory, 2012
- Guaranteed Minimum-Rank Solutions of Linear Matrix Equations via Nuclear Norm MinimizationSIAM Review, 2010
- Sparse solutions to linear inverse problems with multiple measurement vectorsIEEE Transactions on Signal Processing, 2005
- Regression Shrinkage and Selection Via the LassoJournal of the Royal Statistical Society Series B: Statistical Methodology, 1996
- Neuromagnetic source imaging with FOCUSS: a recursive weighted minimum norm algorithmElectroencephalography and Clinical Neurophysiology, 1995
- On a convolution operation obtained by adding level sets : classical and new resultsRAIRO - Operations Research, 1995
- ON A BUNDLE ALGORITHM FOR NONSMOOTH OPTIMIZATION1981