Robust Causal Structure Learning with Some Hidden Variables
Open Access
- 8 March 2019
- journal article
- research article
- Published by Oxford University Press (OUP) in Journal of the Royal Statistical Society Series B: Statistical Methodology
- Vol. 81 (3) , 459-487
Abstract
Summary: We introduce a new method to estimate the Markov equivalence class of a directed acyclic graph (DAG) in the presence of hidden variables, in settings where the underlying DAG among the observed variables is sparse, and there are a few hidden variables that have a direct effect on many of the observed variables. Building on the so-called low rank plus sparse framework, we suggest a two-stage approach which first removes the effect of the hidden variables and then estimates the Markov equivalence class of the underlying DAG under the assumption that there are no remaining hidden variables. This approach is consistent in certain high dimensional regimes and performs favourably when compared with the state of the art, in terms of both graphical structure recovery and total causal effect estimation.Keywords
All Related Versions
This publication has 43 references indexed in Scilit:
- Normalizing RNA-Sequencing Data by Modeling Hidden Covariates with Prior KnowledgePLOS ONE, 2013
- Latent variable graphical model selection via convex optimizationThe Annals of Statistics, 2012
- Using probabilistic estimation of expression residuals (PEER) to obtain increased power and interpretability of gene expression analysesNature Protocols, 2012
- Predicting causal effects in large-scale systems from observational dataNature Methods, 2010
- Defining specificity of transcription factor regulatory activitiesJournal of Cell Science, 2009
- Markov equivalence for ancestral graphsThe Annals of Statistics, 2009
- Causal inference in statistics: An overviewStatistics Surveys, 2009
- Accurate Discovery of Expression Quantitative Trait Loci Under Confounding From Spurious and Genuine Regulatory HotspotsGenetics, 2008
- Capturing Heterogeneity in Gene Expression Studies by Surrogate Variable AnalysisPLOS Genetics, 2007
- The Adaptive Lasso and Its Oracle PropertiesJournal of the American Statistical Association, 2006