Optimal transform formed by a combination of nonlinear operators: the case of data dimensionality reduction
Authors:
- 20 March 2006
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Signal Processing
- Vol. 54 (4) , 1431-1444
Abstract
In this paper, a new approach to constructing optimal nonlinear transforms of random vectors is proposed and justified. The proposed transform T/sub p/ is presented in the form of a sum with p terms where each term is interpreted as a particular rank-reduced transform. Moreover, terms in T/sub p/ are represented as a combination of three operations F/sub k/, Q/sub k/, and /spl psi//sub k/ with k=1,...,p. The prime idea is to determine F/sub k/ separately, for each k=1,...,p, from an associated rank-constrained minimization problem similar to that used in the Karhunen-Loe/spl grave/ve transform (KLT). The operations Q/sub k/ and /spl psi//sub k/ are auxiliary for finding F/sub k/. The contribution of each term in T/sub p/ improves the entire transform performance. A rigorous analysis of errors associated with the proposed transforms is given. It is shown that the proposed transform improves such characteristics of rank-reduced transforms as compression ratio and the accuracy of decompression and reduces required computational work. The Fourier series in Hilbert space, the Wiener filter, the KLT and the transforms presented in earlier author papers in the field are particular cases of the proposed method. Theoretical results are illustrated with numerical simulations.Keywords
This publication has 34 references indexed in Scilit:
- A well-conditioned estimator for large-dimensional covariance matricesJournal of Multivariate Analysis, 2004
- Improved estimation of a covariance matrix in an elliptically contoured matrix distributionJournal of Multivariate Analysis, 2004
- A Krylov Subspace Method for Covariance Approximation and Simulation of Random Processes and FieldsMultidimensional Systems and Signal Processing, 2003
- Estimating the covariance matrix: a new approachJournal of Multivariate Analysis, 2003
- A Note on the Efficiency of Sandwich Covariance Matrix EstimationJournal of the American Statistical Association, 2001
- Performance of reduced-rank linear interference suppressionIEEE Transactions on Information Theory, 2001
- Inference for Density Families Using Functional Principal Component AnalysisJournal of the American Statistical Association, 2001
- Optimal reduced-rank estimation and filteringIEEE Transactions on Signal Processing, 2001
- A multistage representation of the Wiener filter based on orthogonal projectionsIEEE Transactions on Information Theory, 1998
- Estimating a covariance matrix from incomplete realizations of a random vectorIEEE Transactions on Signal Processing, 1992