Aiding the prescriber: developing a machine learning approach to personalized risk modeling for chronic opioid therapy amongst US Army soldiers
- 27 July 2022
- journal article
- research article
- Published by Springer Nature in Health Care Management Science
- Vol. 25 (4) , 649-665
Abstract
The opioid epidemic is a major policy concern. The widespread availability of opioids, which is fueled by physician prescribing patterns, medication diversion, and the interaction with potential illicit opioid use, has been implicated as proximal cause for subsequent opioid dependence and mortality. Risk indicators related to chronic opioid therapy (COT) at the point of care may influence physicians’ prescribing decisions, potentially reducing rates of dependency and abuse. In this paper, we investigate the performance of machine learning algorithms for predicting the risk of COT. Using data on over 12 million observations of active duty US Army soldiers, we apply machine learning models to predict the risk of COT in the initial months of prescription. We use the area under the curve (AUC) as an overall measure of model performance, and we focus on the positive predictive value (PPV), which reflects the models’ ability to accurately target military members for intervention. Of the many models tested, AUC ranges between 0.83 and 0.87. When we focus on the top 1% of members at highest risk, we observe a PPV value of 8.4% and 20.3% for months 1 and 3, respectively. We further investigate the performance of sparse models that can be implemented in sparse data environments. We find that when the goal is to identify patients at the highest risk of chronic use, these sparse linear models achieve a performance similar to models trained on hundreds of variables. Our predictive models exhibit high accuracy and can alert prescribers to the risk of COT for the highest risk patients. Optimized sparse models identify a parsimonious set of factors to predict COT: initial supply of opioids, the supply of opioids in the month being studied, and the number of prescriptions for psychotropic medications. Future research should investigate the possible effects of these tools on prescriber behavior (e.g., the benefit of clinician nudging at the point of care in outpatient settings).Keywords
This publication has 43 references indexed in Scilit:
- A Review of Potential Adverse Effects of Long-Term Opioid TherapyThe Primary Care Companion For CNS Disorders, 2012
- Evaluating alert fatigue over time to EHR-based clinical trial alerts: findings from a randomized controlled studyJournal of the American Medical Informatics Association, 2012
- The Prevalence of Chronic Pain in United States Adults: Results of an Internet-Based SurveyThe Journal of Pain, 2010
- Adverse effects of chronic opioid therapy for chronic musculoskeletal painNature Reviews Rheumatology, 2010
- Opioids for Chronic Noncancer Pain: Prediction and Identification of Aberrant Drug-Related Behaviors: A Review of the Evidence for an American Pain Society and American Academy of Pain Medicine Clinical Practice GuidelineThe Journal of Pain, 2009
- Validation of the Revised Screener and Opioid Assessment for Patients With Pain (SOAPP-R)The Journal of Pain, 2008
- Relaxed LassoComputational Statistics & Data Analysis, 2007
- Predicting Aberrant Behaviors in Opioid-Treated Patients: Preliminary Validation of the Opioid Risk ToolPain Medicine, 2005
- Prediction of Coronary Heart Disease Using Risk Factor CategoriesCirculation, 1998
- Detection of Postnatal DepressionThe British Journal of Psychiatry, 1987