Long-Term Effect Estimation with Surrogate Representation
Authors:
Open Access
- 8 March 2021
- conference paper
- Published by Association for Computing Machinery (ACM)
- p. 274-282
Abstract
There are many scenarios where short- and long-term causal effects of an intervention are different. For example, low-quality ads may increase short-term ad clicks but decrease the long-term revenue via reduced clicks. This work, therefore, studies the the problem of long-term effect where the outcome of primary interest, orprimary outcome, takes months or even years to accumulate. The observational study of long-term effect presents unique challenges. First, the confounding bias causes large estimation error and variance, which can further accumulate towards the prediction of primary outcomes. Second, short-term outcomes are often directly used as the proxy of the primary outcome, i.e., thesurrogate. Nevertheless, this method entails the strong surrogacy assumption that is often impractical. To tackle these challenges, we propose to build connections between long-term causal inference and sequential models in machine learning. This enables us to learnsurrogate representations that account for thetemporal unconfoundedness and circumvent the stringent surrogacy assumption by conditioning on the inferred time-varying confounders. Experimental results show that the proposed framework outperforms the state-of-the-art.Keywords
All Related Versions
Funding Information
- National Science Foundation (1614576)
This publication has 20 references indexed in Scilit:
- On the empirical estimation of integral probability metricsElectronic Journal of Statistics, 2012
- How Does Your Kindergarten Classroom Affect Your Earnings? Evidence from Project StarThe Quarterly Journal of Economics, 2011
- Bayesian Nonparametric Modeling for Causal InferenceJournal of Computational and Graphical Statistics, 2011
- Does analysis using "last observation carried forward" introduce bias in dementia research?Canadian Medical Association Journal, 2008
- Comparison of data analysis strategies for intent-to-treat analysis in pre-test–post-test designs with substantial dropout ratesPsychiatry Research, 2008
- Causal Inference Using Potential OutcomesJournal of the American Statistical Association, 2005
- On the Use of Surrogate End Points in Randomized TrialsJournal of the Royal Statistical Society Series A: Statistics in Society, 2000
- Experimental Estimates of Education Production FunctionsThe Quarterly Journal of Economics, 1999
- Integral Probability Metrics and Their Generating Classes of FunctionsAdvances in Applied Probability, 1997
- Statistics and Causal InferenceJournal of the American Statistical Association, 1986