The Use of Unlabeled Data in Predictive Modeling
Authors:
- Feng LiangFLFeng Liang
- Sayan MukherjeeSMSayan Mukherjee
- Mike WestMWMike West
Open Access
- 1 May 2007
- journal article
- Published by Institute of Mathematical Statistics in Statistical Science
- Vol. 22 (2) , 189-205
Abstract
The incorporation of unlabeled data in regression and classification analysis is an increasing focus of the applied statistics and machine learning literatures, with a number of recent examples demonstrating the potential for unlabeled data to contribute to improved predictive accuracy. The statistical basis for this semisupervised analysis does not appear to have been well delineated; as a result, the underlying theory and rationale may be underappreciated, especially by nonstatisticians. There is also room for statisticians to become more fully engaged in the vigorous research in this important area of intersection of the statistical and computer sciences. Much of the theoretical work in the literature has focused, for example, on geometric and structural properties of the unlabeled data in the context of particular algorithms, rather than probabilistic and statistical questions. This paper overviews the fundamental statistical foundations for predictive modeling and the general questions associated with unlabeled data, highlighting the relevance of venerable concepts of sampling design and prior specification. This theory, illustrated with a series of central illustrative examples and two substantial real data analyses, shows precisely when, why and how unlabeled data matter.Keywords
All Related Versions
This publication has 22 references indexed in Scilit:
- Estimating Dataset Size Requirements for Classifying DNA Microarray DataJournal of Computational Biology, 2003
- Parameter priors for directed acyclic graphical models and the characterization of several probability distributionsThe Annals of Statistics, 2002
- Bayesian curve fitting using multivariate normal mixturesBiometrika, 1996
- Bayesian Density Estimation and Inference Using MixturesJournal of the American Statistical Association, 1995
- On the exponential value of labeled samplesPattern Recognition Letters, 1995
- A Bayesian method for classification and discriminationCanadian Journal of Statistics, 1992
- Regularization Algorithms for Learning That Are Equivalent to Multilayer NetworksScience, 1990
- The efficiency of a linear discriminant function based on unclassified initial samplesBiometrika, 1978
- Normal Discrimination with Unclassified ObservationsJournal of the American Statistical Association, 1978
- A Bayesian Analysis of Some Nonparametric ProblemsThe Annals of Statistics, 1973