Improving counterfactual reasoning with kernelised dynamic mixing models
Authors:
Open Access
- 12 November 2018
- journal article
- research article
- Published by Public Library of Science (PLoS) in PLOS ONE
- Vol. 13 (11) , e0205839
Abstract
Simulation-based approaches to disease progression allow us to make counterfactual predictions about the effects of an untried series of treatment choices. However, building accurate simulators of disease progression is challenging, limiting the utility of these approaches for real world treatment planning. In this work, we present a novel simulation-based reinforcement learning approach that mixes between models and kernel-based approaches to make its forward predictions. On two real world tasks, managing sepsis and treating HIV, we demonstrate that our approach both learns state-of-the-art treatment policies and can make accurate forward predictions about the effects of treatments on unseen patients.Keywords
Funding Information
- Schweizerischer Nationalfonds zur Förderung der Wissenschaftlichen Forschung (51MRP0 158328)
This publication has 24 references indexed in Scilit:
- Deep Computational Phenotyping2015
- Predicting Response to Antiretroviral Treatment by Machine Learning: The EuResist ProjectIntervirology, 2012
- Acute retroviral syndrome and high baseline viral load are predictors of rapid HIV progression among untreated Argentinean seroconvertersJournal of the International AIDS Society, 2011
- A model for predicting lung cancer response to therapyInternational Journal of Radiation Oncology - Biology - Physics (IJROBP), 2007
- Options for a Second-Line Antiretroviral Regimen for HIV Type 1-Infected Patients Whose Initial Regimen of a Fixed-Dose Combination of Stavudine, Lamivudine, and Nevirapine FailsClinical Infectious Diseases, 2007
- Predictors of disease progression in HIV infection: a reviewAIDS Research and Therapy, 2007
- Accurate prediction of HIV-1 drug response from the reverse transcriptase and protease amino acid sequences using sparse models created by convex optimizationBioinformatics, 2005
- Planning and acting in partially observable stochastic domainsArtificial Intelligence, 1998
- On Gibbs sampling for state space modelsBiometrika, 1994
- Methods of Reducing Sample Size in Monte Carlo ComputationsJournal of the Operations Research Society of America, 1953