An analytic approach for interpretable predictive models in high dimensional data, in the presence of interactions with exposures
Preprint
Abstract
Predicting a phenotype and understanding which variables improve that prediction are two very challenging and overlapping problems in analysis of high-dimensional data such as those arising from genomic and brain imaging studies. It is often believed that the number of truly important predictors is small relative to the total number of variables, making computational approaches to variable selection and dimension reduction extremely important. To reduce dimensionality, commonly-used two-step methods first cluster the data in some way, and build models using cluster summaries to predict the phenotype. It is known that important exposure variables can alter correlation patterns between clusters of high-dimensional variables, i.e., alter network properties of the variables. However, it is not well understood whether such altered clustering is informative in prediction. Here, assuming there is a binary exposure with such network-altering effects, we explore whether use of exposure-dependent clustering relationships in dimension reduction can improve predictive modelling in a two-step framework. Hence, we propose a modelling framework called ECLUST to test this hypothesis, and evaluate its performance through extensive simulations. With ECLUST, we found improved prediction and variable selection performance compared to methods that do not consider the environment in the clustering step, or to methods that use the original data as features. We further illustrate this modelling framework through the analysis of three data sets from very different fields, each with high dimensional data, a binary exposure, and a phenotype of interest. Our method is available in the eclust CRAN package.Keywords
All Related Versions
- Published version: Genetic Epidemiology, 42 (3), 233.
This publication has 51 references indexed in Scilit:
- A prospective study of effects of psychological factors and sleep on obstetric interventions, mode of birth, and neonatal outcomes among low-risk British Columbian womenBMC Pregnancy and Childbirth, 2012
- Placental Adiponectin Gene DNA Methylation Levels Are Associated With Mothers’ Blood Glucose ConcentrationDiabetes, 2012
- High density DNA methylation array with single CpG site resolutionGenomics, 2011
- Deregulation of MYCN, LIN28B and LET7 in a Molecular Subtype of Aggressive High-Grade Serous Ovarian CancersPLOS ONE, 2011
- pROC: an open-source package for R and S+ to analyze and compare ROC curvesBMC Bioinformatics, 2011
- Leptin Gene Epigenetic Adaptation to Impaired Glucose Metabolism During PregnancyDiabetes Care, 2010
- A penalized matrix decomposition, with applications to sparse principal components and canonical correlation analysisBiostatistics, 2009
- Evaluation of time profile reconstruction from complex two-color microarray designsBMC Bioinformatics, 2008
- Eigengene networks for studying the relationships between co-expression modulesBMC Systems Biology, 2007
- Insulin signalling and the regulation of glucose and lipid metabolismNature, 2001