Identifying Patterns of Smoking Cessation App Feature Use That Predict Successful Quitting: Secondary Analysis of Experimental Data Leveraging Machine Learning
Open Access
- 22 May 2024
- journal article
- research article
- Published by JMIR Publications Inc. in JMIR AI
- Vol. 3 (1) , e51756
Abstract
Background: Leveraging free smartphone apps can help expand the availability and use of evidence-based smoking cessation interventions. However, there is a need for additional research investigating how the use of different features within such apps impacts their effectiveness. Objective: We used observational data collected from an experiment of a publicly available smoking cessation app to develop supervised machine learning (SML) algorithms intended to distinguish the app features that promote successful smoking cessation. We then assessed the extent to which patterns of app feature use accounted for variance in cessation that could not be explained by other known predictors of cessation (eg, tobacco use behaviors). Methods: Data came from an experiment (ClinicalTrials.gov NCT04623736) testing the impacts of incentivizing ecological momentary assessments within the National Cancer Institute’s quitSTART app. Participants’ (N=133) app activity, including every action they took within the app and its corresponding time stamp, was recorded. Demographic and baseline tobacco use characteristics were measured at the start of the experiment, and short-term smoking cessation (7-day point prevalence abstinence) was measured at 4 weeks after baseline. Logistic regression SML modeling was used to estimate participants’ probability of cessation from 28 variables reflecting participants’ use of different app features, assigned experimental conditions, and phone type (iPhone [Apple Inc] or Android [Google]). The SML model was first fit in a training set (n=100) and then its accuracy was assessed in a held-aside test set (n=33). Within the test set, a likelihood ratio test (n=30) assessed whether adding individuals’ SML-predicted probabilities of cessation to a logistic regression model that included demographic and tobacco use (eg, polyuse) variables explained additional variance in 4-week cessation. Results: The SML model’s sensitivity (0.67) and specificity (0.67) in the held-aside test set indicated that individuals’ patterns of using different app features predicted cessation with reasonable accuracy. The likelihood ratio test showed that the logistic regression, which included the SML model–predicted probabilities, was statistically equivalent to the model that only included the demographic and tobacco use variables (P=.16). Conclusions: Harnessing user data through SML could help determine the features of smoking cessation apps that are most useful. This methodological approach could be applied in future research focusing on smoking cessation app features to inform the development and improvement of smoking cessation apps. Trial Registration: ClinicalTrials.gov NCT04623736; https://clinicaltrials.gov/study/NCT04623736Keywords
All Related Versions
This publication has 28 references indexed in Scilit:
- Using Digital Technologies to Reach Tobacco Users Who Want to Quit: Evidence From the National Cancer Institute's Smokefree.gov InitiativeAmerican Journal of Preventive Medicine, 2021
- Efficacy of Smartphone Applications for Smoking CessationJAMA Internal Medicine, 2020
- Mobile Applications for the Treatment of Tobacco Use and DependenceCurrent Addiction Reports, 2019
- A content analysis of free smoking cessation mobile applications in the USAJournal of Smoking Cessation, 2019
- QUALITY AND USE OF FREE SMOKING CESSATION APPS FOR SMARTPHONESInternational Journal of Technology Assessment in Health Care, 2018
- Missing the mark for patient engagement: mHealth literacy strategies and behavior change processes in smoking cessation appsPatient Education and Counseling, 2018
- A systematic review of smartphone applications for smoking cessationTranslational Behavioral Medicine, 2017
- Characterising smoking cessation smartphone applications in terms of behaviour change techniques, engagement and ease-of-use featuresTranslational Behavioral Medicine, 2015
- Randomized, controlled pilot trial of a smartphone app for smoking cessation using acceptance and commitment therapyDrug and Alcohol Dependence, 2014
- The Fagerström test for nicotine dependence: A comparison of standard scoring and latent class analysis approachesDrug and Alcohol Dependence, 2005