Accelerating the convergence of the method of alternating projections
Open Access
- 29 May 2003
- journal article
- Published by American Mathematical Society (AMS) in Transactions of the American Mathematical Society
- Vol. 355 (9) , 3433-3461
Abstract
The powerful von Neumann-Halperin method of alternating projections (MAP) is an algorithm for determining the best approximation to any given point in a Hilbert space from the intersection of a finite number of subspaces. It achieves this by reducing the problem to an iterative scheme which involves only computing best approximations from the individual subspaces which make up the intersection. The main practical drawback of this algorithm, at least for some applications, is that the method is slowly convergent. In this paper, we consider a general class of iterative methods which includes the MAP as a special case. For such methods, we study an ``accelerated'' version of this algorithm that was considered earlier by Gubin, Polyak, and Raik (1967) and by Gearhart and Koshy (1989). We show that the accelerated algorithm converges faster than the MAP in the case of two subspaces, but is, in general, not faster than the MAP for more than two subspaces! However, for a ``symmetric'' version of the MAP, the accelerated algorithm always converges faster for any number of subspaces. Our proof seems to require the use of the Spectral Theorem for selfadjoint mappings.Keywords
This publication has 17 references indexed in Scilit:
- Introduction to Hilbert Spaces with ApplicationsJournal of the American Statistical Association, 1999
- The method of cyclic projections for closed convex sets in Hilbert space1997
- The rate of convergence of dykstra's cyclic projections algorithm: The polyhedral caseNumerical Functional Analysis and Optimization, 1994
- Acceleration schemes for the method of alternating projectionsJournal of Computational and Applied Mathematics, 1989
- Practical and mathematical aspects of the problem of reconstructing objects from radiographsBulletin of the American Mathematical Society, 1977
- The method of projections for finding the common point of convex setsUSSR Computational Mathematics and Mathematical Physics, 1967
- Theory of Reproducing KernelsTransactions of the American Mathematical Society, 1950
- The Lattice Theory of OvaAnnals of Mathematics, 1939
- Steinitz Field Towers for Modular FieldsTransactions of the American Mathematical Society, 1939
- On certain inequalities and characteristic value problems for analytic functions and for functions of two variablesTransactions of the American Mathematical Society, 1937