Matched-Pair Machine Learning
Author:
- 6 September 2013
- journal article
- research article
- Published by Taylor & Francis in Technometrics
- Vol. 55 (4) , 536-547
Abstract
Following an analogous distinction in statistical hypothesis testing and motivated by chemical plume detection in hyperspectral imagery, we investigate machine-learning algorithms where the training set is comprised of matched pairs. We find that even conventional classifiers exhibit improved performance when the input data have a matched-pair structure, and we develop an example of a “dipole” algorithm to directly exploit this structured input. In some scenarios, matched pairs can be generated from independent samples, with the effect of not only doubling the nominal size of the training set, but of providing the matched-pair structure that leads to better learning. The creation of matched pairs from a dataset of interest also permits a kind of transductive learning, which is found for the plume detection problem to exhibit improved performance. Supplementary materials for this article are available online.Keywords
This publication has 9 references indexed in Scilit:
- Decision boundaries in two dimensions for target detection in hyperspectral imageryOptics Express, 2009
- Statistics2005
- Modern Applied Statistics with S2002
- The Elements of Statistical Learning2001
- Determination of trace-gas amounts in plumes by the use of orthogonal digital filtering of thermal-emission spectraApplied Optics, 1996
- The airborne visible/infrared imaging spectrometer (AVIRIS)Remote Sensing of Environment, 1993
- Regularized Discriminant AnalysisJournal of the American Statistical Association, 1989
- A Stochastic Approximation MethodThe Annals of Mathematical Statistics, 1951
- Bestimmung der Absorption des rothen Lichts in farbigen FlüssigkeitenAnnalen der Physik, 1852