On the Solution of the Tikhonov Regularization of the Total Least Squares Problem
Authors:
- Amir BeckABAmir Beck
- Aharon Ben-TalABAharon Ben-Tal
- 1 January 2006
- journal article
- Published by Society for Industrial & Applied Mathematics (SIAM) in SIAM Journal on Optimization
- Vol. 17 (1) , 98-118
Abstract
Total least squares (TLS) is a method for treating an overdetermined system of linear equations ${\bf A} {\bf x} \approx {\bf b}$, where both the matrix ${\bf A}$ and the vector ${\bf b}$ are contaminated by noise. Tikhonov regularization of the TLS (TRTLS) leads to an optimization problem of minimizing the sum of fractional quadratic and quadratic functions. As such, the problem is nonconvex. We show how to reduce the problem to a single variable minimization of a function ${\mathcal{G}}$ over a closed interval. Computing a value and a derivative of ${\mathcal{G}}$ consists of solving a single trust region subproblem. For the special case of regularization with a squared Euclidean norm we show that ${\mathcal{G}}$ is unimodal and provide an alternative algorithm, which requires only one spectral decomposition. A numerical example is given to illustrate the effectiveness of our method.
Keywords
This publication has 26 references indexed in Scilit:
- Regularized Total Least Squares Based on Quadratic Eigenvalue Problem SolversBIT Numerical Mathematics, 2004
- The trust region subproblem and semidefinite programming*Optimization Methods and Software, 2004
- Minimization of a Large-Scale Quadratic FunctionSubject to a Spherical ConstraintSIAM Journal on Optimization, 1997
- Indefinite Trust Region Subproblems and Nonsymmetric Eigenvalue PerturbationsSIAM Journal on Optimization, 1995
- A constrained eigenvalue problemLinear Algebra and its Applications, 1989
- Computing a Trust Region StepSIAM Journal on Scientific and Statistical Computing, 1983
- The Conjugate Gradient Method and Trust Regions in Large Scale OptimizationSIAM Journal on Numerical Analysis, 1983
- On the Estimation of a Probability Density Function by the Maximum Penalized Likelihood MethodThe Annals of Statistics, 1982
- Differential properties of the marginal function in mathematical programming1982
- An Analysis of the Total Least Squares ProblemSIAM Journal on Numerical Analysis, 1980