Methods of Selecting Informative Variables
- 15 February 2006
- journal article
- research article
- Published by Wiley in Biometrical Journal
- Vol. 48 (1) , 157-173
Abstract
We propose a new method for selection of the most informative variables from the set of variables which can be measured directly. The information is measured by metrics similar to those used in experimental design theory, such as determinant of the dispersion matrix of prediction or various functions of its eigenvalues. The basic model admits both population variability and observational errors, which allows us to introduce algorithms based on ideas of optimal experimental design. Moreover, we can take into account cost of measuring various variables which makes the approach more practical. It is shown that the selection of optimal subsets of variables is invariant to scale transformations unlike other methods of dimension reduction, such as principal components analysis or methods based on direct selection of variables, for instance principal variables and battery reduction. The performance of different approaches is compared using the clinical data.Keywords
This publication has 10 references indexed in Scilit:
- Component-wise dimension reductionJournal of Statistical Planning and Inference, 2003
- Design of experiments with unknown parameters in varianceApplied Stochastic Models in Business and Industry, 2002
- Variable selection and the interpretation of principal subspacesJournal of Agricultural, Biological and Environmental Statistics, 2001
- Maximum Entropy Sampling and Optimal Bayesian Experimental DesignJournal of the Royal Statistical Society Series B: Statistical Methodology, 2000
- Optimality Assessment in the Enzyme-Linked Immunosorbent Assay (ELISA)1990
- Maximum entropy samplingJournal of Applied Statistics, 1987
- Principal VariablesTechnometrics, 1984
- Radioligand AssayBiometrics, 1976
- Correcting Inhomogeneity of Variance with Power Transformation WeightingTechnometrics, 1974
- The Equivalence of Two Extremum ProblemsCanadian Journal of Mathematics, 1960