Diffusion Based Causal Representation Learning
Authors:
- Amir Mohammad Karimi MamaghanAMAmir Mohammad Karimi Mamaghan
Preprint
Abstract
Causal reasoning can be considered a cornerstone of intelligent systems. Having access to an underlying causal graph comes with the promise of cause-effect estimation and the identification of efficient and safe interventions. However, learning causal representations remains a major challenge, due to the complexity of many real-world systems. Previous works on causal representation learning have mostly focused on Variational Auto-Encoders (VAE). These methods only provide representations from a point estimate, and they are unsuitable to handle high dimensions. To overcome these problems, we proposed a new Diffusion-based Causal Representation Learning (DCRL) algorithm. This algorithm uses diffusion-based representations for causal discovery. DCRL offers access to infinite dimensional latent codes, which encode different levels of information in the latent code. In a first proof of principle, we investigate the use of DCRL for causal representation learning. We further demonstrate experimentally that this approach performs comparably well in identifying the causal structure and causal variables.Keywords
All Related Versions
This publication has 7 references indexed in Scilit:
- The relevance of causation in robotics: A review, categorization, and analysisPaladyn, Journal of Robotics, Intelligent Agents, and Artificial Intelligence, 2021
- Inferring causation from time series in Earth system sciencesNature Communications, 2019
- Multi-modal causality analysis of eyes-open and eyes-closed data from simultaneously recorded EEG and MEG2014
- A Connection Between Score Matching and Denoising AutoencodersNeural Computation, 2011
- Marginal Structural Models and Causal Inference in EpidemiologyEpidemiology, 2000
- Marginal Structural Models to Estimate the Causal Effect of Zidovudine on the Survival of HIV-Positive MenEpidemiology, 2000
- Independent component analysis: algorithms and applicationsNeural Networks, 2000