Daniel H. Funk
Daniel H. Funk has a total of 19 co-authors. Here are the top co-authors by number of shared publications:
- Bethany Ann Teachman
Department of Psychology, University of Virginia
4 shared publications - Jeremy William Eberle
University of Virginia
4 shared publications - Laura E. Barnes
University of Virginia
4 shared publications - Anna N. Baglione
Department of Engineering Systems and Environment, University of Virginia, Charlottesville, VA, United States
3 shared publications - Elijah Lewis
Department of Computer Science, University of Virginia, Charlottesville, VA, United States
3 shared publications - Sonia Baee
Department of Systems and Information Engineering, University of Virginia, Charlottesville, VA, United States
3 shared publications
Latest Publications
- Open Access
- 20 December 2024
- Published by JMIR Publications Inc. in JMIR Mental Health
- Vol. 11 (1) , e51567
Early Attrition Prediction for Web-Based Interpretation Bias Modification to Reduce Anxious Thinking: A Machine Learning Study
Background: Digital mental health is a promising paradigm for individualized, patient-driven health care. For example, cognitive bias modification programs that target interpretation biases (cognitive bias modification for interpretation [CBM-I]) can provide practice thinking about ambiguous situations in less threatening ways on the web without requiring a therapist. However, digital mental health interventions, including CBM-I, are often plagued with lack of sustained engagement and high attrition rates. New attrition detection and mitigation strategies are needed to improve these interventions. Objective: This paper aims to identify participants at a high risk of dropout during the early stages of 3 web-based trials of multisession CBM-I and to investigate which self-reported and passively detected feature sets computed from the participants interacting with the intervention and assessments were most informative in making this prediction. Methods: The participants analyzed in this paper were community adults with traits such as anxiety or negative thinking about the future (Study 1: n=252, Study 2: n=326, Study 3: n=699) who had been assigned to CBM-I conditions in 3 efficacy-effectiveness trials on our team’s public research website. To identify participants at a high risk of dropout, we created 4 unique feature sets: self-reported baseline user characteristics (eg, demographics), self-reported user context and reactions to the program (eg, state affect), self-reported user clinical functioning (eg, mental health symptoms), and passively detected user behavior on the website (eg, time spent on a web page of CBM-I training exercises, time of day during which the exercises were completed, latency of completing the assessments, and type of device used). Then, we investigated the feature sets as potential predictors of which participants were at high risk of not starting the second training session of a given program using well-known machine learning algorithms. Results: The extreme gradient boosting algorithm performed the best and identified participants at high risk with macro–F1-scores of .832 (Study 1 with 146 features), .770 (Study 2 with 87 features), and .917 (Study 3 with 127 features). Features involving passive detection of user behavior contributed the most to the prediction relative to other features. The mean Gini importance scores for the passive features were as follows: .033 (95% CI .019-.047) in Study 1; .029 (95% CI .023-.035) in Study 2; and .045 (95% CI .039-.051) in Study 3. However, using all features extracted from a given study led to the best predictive performance. Conclusions: These results suggest that using passive indicators of user behavior, alongside self-reported measures, can improve the accuracy of prediction of participants at a high risk of dropout early during multisession CBM-I programs. Furthermore, our analyses highlight the challenge of generalizability in digital health intervention studies and the need for more personalized attrition prevention strategies.
- 20 December 2024
- Published by JMIR Publications Inc. in JMIR Mental Health
- Vol. 11 (1) , e51567
Open AccessEarly Attrition Prediction for Web-Based Interpretation Bias Modification to Reduce Anxious Thinking: A Machine Learning Study
Background: Digital mental health is a promising paradigm for individualized, patient-driven health care. For example, cognitive bias modification programs that target interpretation biases (cognitive bias modification for interpretation [CBM-I]) can provide practice thinking about ambiguous situations in less threatening ways on the web without requiring a therapist. However, digital mental health interventions, including CBM-I, are often plagued with lack of sustained engagement and high attrition rates. New attrition detection and mitigation strategies are needed to improve these interventions. Objective: This paper aims to identify participants at a high risk of dropout during the early stages of 3 web-based trials of multisession CBM-I and to investigate which self-reported and passively detected feature sets computed from the participants interacting with the intervention and assessments were most informative in making this prediction. Methods: The participants analyzed in this paper were community adults with traits such as anxiety or negative thinking about the future (Study 1: n=252, Study 2: n=326, Study 3: n=699) who had been assigned to CBM-I conditions in 3 efficacy-effectiveness trials on our team’s public research website. To identify participants at a high risk of dropout, we created 4 unique feature sets: self-reported baseline user characteristics (eg, demographics), self-reported user context and reactions to the program (eg, state affect), self-reported user clinical functioning (eg, mental health symptoms), and passively detected user behavior on the website (eg, time spent on a web page of CBM-I training exercises, time of day during which the exercises were completed, latency of completing the assessments, and type of device used). Then, we investigated the feature sets as potential predictors of which participants were at high risk of not starting the second training session of a given program using well-known machine learning algorithms. Results: The extreme gradient boosting algorithm performed the best and identified participants at high risk with macro–F1-scores of .832 (Study 1 with 146 features), .770 (Study 2 with 87 features), and .917 (Study 3 with 127 features). Features involving passive detection of user behavior contributed the most to the prediction relative to other features. The mean Gini importance scores for the passive features were as follows: .033 (95% CI .019-.047) in Study 1; .029 (95% CI .023-.035) in Study 2; and .045 (95% CI .039-.051) in Study 3. However, using all features extracted from a given study led to the best predictive performance. Conclusions: These results suggest that using passive indicators of user behavior, alongside self-reported measures, can improve the accuracy of prediction of participants at a high risk of dropout early during multisession CBM-I programs. Furthermore, our analyses highlight the challenge of generalizability in digital health intervention studies and the need for more personalized attrition prevention strategies.
- 1 June 2024
- Published by American Psychological Association (APA) in Journal of Consulting and Clinical Psychology
- Vol. 92 (6) , 367-384
Web-based interpretation bias training to reduce anxiety: A sequential, multiple-assignment randomized trial.
Web-based cognitive bias modification for interpretation (CBM-I) can improve interpretation biases and anxiety symptoms but faces high rates of dropout. This study tested the effectiveness of web-based CBM-I relative to an active psychoeducation condition and the addition of low-intensity telecoaching for a subset of CBM-I participants. 1,234 anxious community adults (Mage = 35.09 years, 81.2% female, 72.1% white, 82.6% not Hispanic) were randomly assigned at Stage 1 of a sequential, multiple-assignment randomized trial to complete five weekly sessions of CBM-I or psychoeducation on our team's public research website. After the first session, for Stage 2, an algorithm attempted to classify CBM-I participants as higher (vs. lower) risk for dropping out; those classified as higher risk were then randomly assigned to complete four brief weekly telecoaching check-ins (vs. no coaching). As hypothesized (https://doi.org/j2xr; Daniel, Eberle, & Teachman, 2020), CBM-I significantly outperformed psychoeducation at improving positive and negative interpretation biases (Recognition Ratings, Brief Body Sensations Interpretation Questionnaire) and anxiety symptoms (Overall Anxiety Severity and Impairment Scale, Anxiety Scale from Depression Anxiety Stress Scales-Short Form), with smaller treatment gains remaining significant at 2-month follow-up. Unexpectedly, CBM-I had significantly worse treatment dropout outcomes than psychoeducation, and adding coaching (vs. no coaching) did not significantly improve efficacy or dropout outcomes (notably, many participants chose not to interact with their coach). Web-based CBM-I appears effective, but supplemental coaching may not mitigate the challenge of dropout. (PsycInfo Database Record (c) 2024 APA, all rights reserved).
- 1 June 2024
- Published by American Psychological Association (APA) in Journal of Consulting and Clinical Psychology
- Vol. 92 (6) , 367-384
Web-based interpretation bias training to reduce anxiety: A sequential, multiple-assignment randomized trial.
Web-based cognitive bias modification for interpretation (CBM-I) can improve interpretation biases and anxiety symptoms but faces high rates of dropout. This study tested the effectiveness of web-based CBM-I relative to an active psychoeducation condition and the addition of low-intensity telecoaching for a subset of CBM-I participants. 1,234 anxious community adults (Mage = 35.09 years, 81.2% female, 72.1% white, 82.6% not Hispanic) were randomly assigned at Stage 1 of a sequential, multiple-assignment randomized trial to complete five weekly sessions of CBM-I or psychoeducation on our team's public research website. After the first session, for Stage 2, an algorithm attempted to classify CBM-I participants as higher (vs. lower) risk for dropping out; those classified as higher risk were then randomly assigned to complete four brief weekly telecoaching check-ins (vs. no coaching). As hypothesized (https://doi.org/j2xr; Daniel, Eberle, & Teachman, 2020), CBM-I significantly outperformed psychoeducation at improving positive and negative interpretation biases (Recognition Ratings, Brief Body Sensations Interpretation Questionnaire) and anxiety symptoms (Overall Anxiety Severity and Impairment Scale, Anxiety Scale from Depression Anxiety Stress Scales-Short Form), with smaller treatment gains remaining significant at 2-month follow-up. Unexpectedly, CBM-I had significantly worse treatment dropout outcomes than psychoeducation, and adding coaching (vs. no coaching) did not significantly improve efficacy or dropout outcomes (notably, many participants chose not to interact with their coach). Web-based CBM-I appears effective, but supplemental coaching may not mitigate the challenge of dropout. (PsycInfo Database Record (c) 2024 APA, all rights reserved).
- Open Access
- 3 August 2023
- Published by JMIR Publications Inc. in JMIR Preprints
Early Attrition Prediction for Web-Based Interpretation Bias Modification to Reduce Anxious Thinking: A Machine Learning Study (Preprint)
BACKGROUND Digital mental health is a promising paradigm for individualized, patient-driven health care. For example, cognitive bias modification programs that target interpretation biases (cognitive bias modification for interpretation [CBM-I]) can provide practice thinking about ambiguous situations in less threatening ways on the web without requiring a therapist. However, digital mental health interventions, including CBM-I, are often plagued with lack of sustained engagement and high attrition rates. New attrition detection and mitigation strategies are needed to improve these interventions. OBJECTIVE This paper aims to identify participants at a high risk of dropout during the early stages of 3 web-based trials of multisession CBM-I and to investigate which self-reported and passively detected feature sets computed from the participants interacting with the intervention and assessments were most informative in making this prediction. METHODS The participants analyzed in this paper were community adults with traits such as anxiety or negative thinking about the future (Study 1: n=252, Study 2: n=326, Study 3: n=699) who had been assigned to CBM-I conditions in 3 efficacy-effectiveness trials on our team’s public research website. To identify participants at a high risk of dropout, we created 4 unique feature sets: self-reported baseline user characteristics (eg, demographics), self-reported user context and reactions to the program (eg, state affect), self-reported user clinical functioning (eg, mental health symptoms), and passively detected user behavior on the website (eg, time spent on a web page of CBM-I training exercises, time of day during which the exercises were completed, latency of completing the assessments, and type of device used). Then, we investigated the feature sets as potential predictors of which participants were at high risk of not starting the second training session of a given program using well-known machine learning algorithms. RESULTS The extreme gradient boosting algorithm performed the best and identified participants at high risk with macro–F1-scores of .832 (Study 1 with 146 features), .770 (Study 2 with 87 features), and .917 (Study 3 with 127 features). Features involving passive detection of user behavior contributed the most to the prediction relative to other features. The mean Gini importance scores for the passive features were as follows: .033 (95% CI .019-.047) in Study 1; .029 (95% CI .023-.035) in Study 2; and .045 (95% CI .039-.051) in Study 3. However, using all features extracted from a given study led to the best predictive performance. CONCLUSIONS These results suggest that using passive indicators of user behavior, alongside self-reported measures, can improve the accuracy of prediction of participants at a high risk of dropout early during multisession CBM-I programs. Furthermore, our analyses highlight the challenge of generalizability in digital health intervention studies and the need for more personalized attrition prevention strategies.
- 3 August 2023
- Published by JMIR Publications Inc. in JMIR Preprints
Open AccessEarly Attrition Prediction for Web-Based Interpretation Bias Modification to Reduce Anxious Thinking: A Machine Learning Study (Preprint)
BACKGROUND Digital mental health is a promising paradigm for individualized, patient-driven health care. For example, cognitive bias modification programs that target interpretation biases (cognitive bias modification for interpretation [CBM-I]) can provide practice thinking about ambiguous situations in less threatening ways on the web without requiring a therapist. However, digital mental health interventions, including CBM-I, are often plagued with lack of sustained engagement and high attrition rates. New attrition detection and mitigation strategies are needed to improve these interventions. OBJECTIVE This paper aims to identify participants at a high risk of dropout during the early stages of 3 web-based trials of multisession CBM-I and to investigate which self-reported and passively detected feature sets computed from the participants interacting with the intervention and assessments were most informative in making this prediction. METHODS The participants analyzed in this paper were community adults with traits such as anxiety or negative thinking about the future (Study 1: n=252, Study 2: n=326, Study 3: n=699) who had been assigned to CBM-I conditions in 3 efficacy-effectiveness trials on our team’s public research website. To identify participants at a high risk of dropout, we created 4 unique feature sets: self-reported baseline user characteristics (eg, demographics), self-reported user context and reactions to the program (eg, state affect), self-reported user clinical functioning (eg, mental health symptoms), and passively detected user behavior on the website (eg, time spent on a web page of CBM-I training exercises, time of day during which the exercises were completed, latency of completing the assessments, and type of device used). Then, we investigated the feature sets as potential predictors of which participants were at high risk of not starting the second training session of a given program using well-known machine learning algorithms. RESULTS The extreme gradient boosting algorithm performed the best and identified participants at high risk with macro–F1-scores of .832 (Study 1 with 146 features), .770 (Study 2 with 87 features), and .917 (Study 3 with 127 features). Features involving passive detection of user behavior contributed the most to the prediction relative to other features. The mean Gini importance scores for the passive features were as follows: .033 (95% CI .019-.047) in Study 1; .029 (95% CI .023-.035) in Study 2; and .045 (95% CI .039-.051) in Study 3. However, using all features extracted from a given study led to the best predictive performance. CONCLUSIONS These results suggest that using passive indicators of user behavior, alongside self-reported measures, can improve the accuracy of prediction of participants at a high risk of dropout early during multisession CBM-I programs. Furthermore, our analyses highlight the challenge of generalizability in digital health intervention studies and the need for more personalized attrition prevention strategies.
- 16 February 2023
- Published by SAGE Publications in Clinical Psychological Science
- Vol. 11 (5) , 819-840
Shifting Episodic Prediction With Online Cognitive Bias Modification: A Randomized Controlled Trial
Negative future thinking pervades emotional disorders. This hybrid efficacy–effectiveness trial tested a four-session, scalable online cognitive-bias-modification program for training more positive episodic prediction. Nine hundred fifty-eight adults (73.3% female, 86.5% White, 83.4% from United States) were randomly assigned to positive conditions with ambiguous future scenarios that ended positively, 50/50 conditions that ended positively or negatively, or a control condition with neutral scenarios. As hypothesized (preregistration: https://osf.io/jrst6 ), positive-training participants improved more than control participants in negative expectancy bias ( d = −0.58), positive expectancy bias ( d = 0.80), and self-efficacy ( d = 0.29). Positive training was also superior to 50/50 training for expectancy bias and optimism ( d = 0.31). Training gains attenuated yet remained by 1-month follow-up. Unexpectedly, participants across conditions improved comparably in anxiety and depression symptoms and growth mindset. Targeting a transdiagnostic process with a scalable program may improve bias and outlook; however, further validation of outcome measures is required.
- 16 February 2023
- Published by SAGE Publications in Clinical Psychological Science
- Vol. 11 (5) , 819-840
Shifting Episodic Prediction With Online Cognitive Bias Modification: A Randomized Controlled Trial
Negative future thinking pervades emotional disorders. This hybrid efficacy–effectiveness trial tested a four-session, scalable online cognitive-bias-modification program for training more positive episodic prediction. Nine hundred fifty-eight adults (73.3% female, 86.5% White, 83.4% from United States) were randomly assigned to positive conditions with ambiguous future scenarios that ended positively, 50/50 conditions that ended positively or negatively, or a control condition with neutral scenarios. As hypothesized (preregistration: https://osf.io/jrst6 ), positive-training participants improved more than control participants in negative expectancy bias ( d = −0.58), positive expectancy bias ( d = 0.80), and self-efficacy ( d = 0.29). Positive training was also superior to 50/50 training for expectancy bias and optimism ( d = 0.31). Training gains attenuated yet remained by 1-month follow-up. Unexpectedly, participants across conditions improved comparably in anxiety and depression symptoms and growth mindset. Targeting a transdiagnostic process with a scalable program may improve bias and outlook; however, further validation of outcome measures is required.
- 20 December 2022
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Software
- Vol. 40 (1) , 9-17
Creating a Low-Code Business Process Execution Platform With Python, BPMN, and DMN
How our software development team used an open source Python library and the popular modeling notation, BPMN, to shed light on a set of complex approval processes at a university. In the course of heavily extending the existing library, and developing 100’s of diagrams, we learned many lessons. Here we will provide a brief high-level introduction to BPMN and DMN and cover what we learned about BPMN training for the emerging Citizen Developer role. We will also discuss the benefits we found in the untraditional combination of BPMN and Python, and close with our current efforts and plans for continued open source development.
- 20 December 2022
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Software
- Vol. 40 (1) , 9-17
Creating a Low-Code Business Process Execution Platform With Python, BPMN, and DMN
How our software development team used an open source Python library and the popular modeling notation, BPMN, to shed light on a set of complex approval processes at a university. In the course of heavily extending the existing library, and developing 100’s of diagrams, we learned many lessons. Here we will provide a brief high-level introduction to BPMN and DMN and cover what we learned about BPMN training for the emerging Citizen Developer role. We will also discuss the benefits we found in the untraditional combination of BPMN and Python, and close with our current efforts and plans for continued open source development.