Use of a machine learning framework to predict substance use disorder treatment success
Open Access
- 10 April 2017
- journal article
- research article
- Published by Public Library of Science (PLoS) in PLOS ONE
- Vol. 12 (4) , e0175383
Abstract
There are several methods for building prediction models. The wealth of currently available modeling techniques usually forces the researcher to judge, a priori, what will likely be the best method. Super learning (SL) is a methodology that facilitates this decision by combining all identified prediction algorithms pertinent for a particular prediction problem. SL generates a final model that is at least as good as any of the other models considered for predicting the outcome. The overarching aim of this work is to introduce SL to analysts and practitioners. This work compares the performance of logistic regression, penalized regression, random forests, deep learning neural networks, and SL to predict successful substance use disorders (SUD) treatment. A nationwide database including 99,013 SUD treatment patients was used. All algorithms were evaluated using the area under the receiver operating characteristic curve (AUC) in a test sample that was not included in the training sample used to fit the prediction models. AUC for the models ranged between 0.793 and 0.820. SL was superior to all but one of the algorithms compared. An explanation of SL steps is provided. SL is the first step in targeted learning, an analytic framework that yields double robust effect estimation and inference with fewer assumptions than the usual parametric methods. Different aspects of SL depending on the context, its function within the targeted learning framework, and the benefits of this methodology in the addiction field are discussed.Keywords
Funding Information
- Consejo Nacional de Investigaciones Científicas y Técnicas (Postdoctoral Fellowship 2651/2014)
This publication has 33 references indexed in Scilit:
- How the states stack up: Disparities in substance abuse outpatient treatment completion rates for minoritiesDrug and Alcohol Dependence, 2013
- Mortality Risk Score Prediction in an Elderly Population Using Machine LearningAmerican Journal of Epidemiology, 2013
- pROC: an open-source package for R and S+ to analyze and compare ROC curvesBMC Bioinformatics, 2011
- MTML-msBayes: Approximate Bayesian comparative phylogeographic inference from multiple taxa and multiple loci with rate heterogeneityBMC Bioinformatics, 2011
- Client and program factors associated with dropout from court mandated drug treatmentEvaluation and Program Planning, 2009
- Adapting Washington Circle performance measures for public sector substance abuse treatment systemsJournal of Substance Abuse Treatment, 2009
- Learning Deep Architectures for AIFoundations and Trends in Machine Learning, 2009
- Super LearnerStatistical Applications in Genetics and Molecular Biology, 2007
- Drug treatment completion and post-discharge employment in the TOPPS-II Interstate Cooperative StudyJournal of Substance Abuse Treatment, 2003
- Ethnic Disparities in Unmet Need for Alcoholism, Drug Abuse, and Mental Health CareAmerican Journal of Psychiatry, 2001