Ashkan Ertefaie
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Previous Organizations / Institutes
The organizations / institutes from the scholar's other articles in the past ten years
Research Subjects
Ashkan Ertefaie has a total of 91 co-authors. Here are the top co-authors by number of shared publications:
Sean Hennessy
Division of Epidemiology, DBEI University of Pennsylvania Philadelphia Pennsylvania USA
7 shared publicationsDylan S. Small
Department of Statistics, the Wharton School, University of Pennsylvania
5 shared publications- Dylan S. Small
Department of Statistics and Data Science, University of Pennsylvania , 265 South 37th Street , Philadelphia, Pennsylvania 19104
5 shared publications - Anthony R. Pisani
Department of Psychiatry and Pediatrics, University of Rochester Medical Center, Rochester, NY, United States of America
3 shared publications - Brent A. Johnson
Department of Biostatistics and Computational Biology, University of Rochester, Rochester, NY 14642, USA
3 shared publications James Flory
Department of Subspecialty Medicine Memorial Sloan Kettering Cancer Center New York New York USA
3 shared publications
Latest Publications
- 1 January 2026
- Published by Institute of Mathematical Statistics in Electronic Journal of Statistics
- Vol. 20 (1) , 1648-1665
Valid post-selection inference for penalized G-estimation
Understanding treatment effect heterogeneity is important for decision-making in medical and clinical practices, or handling various engineering and marketing challenges. When dealing with high-dimensional covariates or when the effect modifiers are not predefined and need to be discovered, data-adaptive selection approaches become essential. However, with data-driven model selection, the quantification of statistical uncertainty is complicated by post-selection inference due to difficulties in approximating the sampling distribution of the target estimator. Data-driven model selection tends to favor models with strong effect modifiers with an associated cost of inflated type I errors. Although several frameworks and methods for valid statistical inference have been proposed for ordinary least squares regression following data-driven model selection, fewer options exist for valid inference for effect modifier discovery in causal modeling contexts. In this article, we extend two different methods to develop valid inference for penalized G-estimation that investigates effect modification of proximal treatment effects within the structural nested mean model framework. We show the asymptotic validity of the proposed inferential methods. In our simulation study, the proposed methods effectively controlled the false coverage rates for the target parameters, while the naive inference based on the sandwich variance estimator resulted in false coverage rates higher than the nominal level. Our work is motivated by the study of hemodiafiltration for treating patients with end-stage renal disease at the Centre Hospitalier de l’Université de Montréal. We apply these methods to draw inference about the effect heterogeneity of dialysis facility on the repeated session-specific hemodiafiltration outcomes.
- 1 January 2026
- Published by Institute of Mathematical Statistics in Electronic Journal of Statistics
- Vol. 20 (1) , 1648-1665
Valid post-selection inference for penalized G-estimation
Understanding treatment effect heterogeneity is important for decision-making in medical and clinical practices, or handling various engineering and marketing challenges. When dealing with high-dimensional covariates or when the effect modifiers are not predefined and need to be discovered, data-adaptive selection approaches become essential. However, with data-driven model selection, the quantification of statistical uncertainty is complicated by post-selection inference due to difficulties in approximating the sampling distribution of the target estimator. Data-driven model selection tends to favor models with strong effect modifiers with an associated cost of inflated type I errors. Although several frameworks and methods for valid statistical inference have been proposed for ordinary least squares regression following data-driven model selection, fewer options exist for valid inference for effect modifier discovery in causal modeling contexts. In this article, we extend two different methods to develop valid inference for penalized G-estimation that investigates effect modification of proximal treatment effects within the structural nested mean model framework. We show the asymptotic validity of the proposed inferential methods. In our simulation study, the proposed methods effectively controlled the false coverage rates for the target parameters, while the naive inference based on the sandwich variance estimator resulted in false coverage rates higher than the nominal level. Our work is motivated by the study of hemodiafiltration for treating patients with end-stage renal disease at the Centre Hospitalier de l’Université de Montréal. We apply these methods to draw inference about the effect heterogeneity of dialysis facility on the repeated session-specific hemodiafiltration outcomes.
- Open Access
- 28 November 2025
- Published by Wiley in Pharmacotherapy: The Journal of Human Pharmacology and Drug Therapy
- Vol. 46 (1)
Constructing a Personalized Treatment Rule for Initial Therapy in Early Parkinson's Disease
Background: Dopaminergic therapies such as levodopa and dopamine receptor agonists (DRA) improve motor function in people with Parkinson's disease. These therapies are also linked to the advent of motor complications such as dyskinesias and wearing‐off episodes. Objectives: We illustrate a method that creates a personalized treatment rule that takes patient‐specific information and provides a recommended first‐line therapy for Parkinson's disease that will provide the best mean improvement in motor function while constraining the probability of a motor complication within the first 2 years of therapy below a level mutually deemed to be the maximum acceptable risk by the patient and clinician. Methods: We apply a machine learning technique that simultaneously optimizes for benefit and risk outcomes to a harmonized clinical dataset based on the CALM‐PD and STEADY‐PD III randomized clinical trials. This generates a decision rule for allocating patients to levodopa or a DRA, based on a specified risk threshold. We evaluate the individualized decision rule by comparing the mean benefit and risk outcomes under the decision rule to the mean outcomes from policies that assign all patients to either levodopa or a DRA. Results: The optimal decision rule improves the mean change from baseline in MDS‐UPDRS (Movement Disorder Society Unified Parkinson's Disease Rating Scale) motor (Part 3) score compared to assigning all patients to a DRA and provides a smaller mean probability of motor complications than assigning all patients to levodopa. More data are required to further develop and validate this decision rule. Conclusions: An optimal decision rule can provide improved data adaptive treatment decisions that balance benefit and risk outcomes given a maximum acceptable risk.
- 28 November 2025
- Published by Wiley in Pharmacotherapy: The Journal of Human Pharmacology and Drug Therapy
- Vol. 46 (1)
Open AccessConstructing a Personalized Treatment Rule for Initial Therapy in Early Parkinson's Disease
Background: Dopaminergic therapies such as levodopa and dopamine receptor agonists (DRA) improve motor function in people with Parkinson's disease. These therapies are also linked to the advent of motor complications such as dyskinesias and wearing‐off episodes. Objectives: We illustrate a method that creates a personalized treatment rule that takes patient‐specific information and provides a recommended first‐line therapy for Parkinson's disease that will provide the best mean improvement in motor function while constraining the probability of a motor complication within the first 2 years of therapy below a level mutually deemed to be the maximum acceptable risk by the patient and clinician. Methods: We apply a machine learning technique that simultaneously optimizes for benefit and risk outcomes to a harmonized clinical dataset based on the CALM‐PD and STEADY‐PD III randomized clinical trials. This generates a decision rule for allocating patients to levodopa or a DRA, based on a specified risk threshold. We evaluate the individualized decision rule by comparing the mean benefit and risk outcomes under the decision rule to the mean outcomes from policies that assign all patients to either levodopa or a DRA. Results: The optimal decision rule improves the mean change from baseline in MDS‐UPDRS (Movement Disorder Society Unified Parkinson's Disease Rating Scale) motor (Part 3) score compared to assigning all patients to a DRA and provides a smaller mean probability of motor complications than assigning all patients to levodopa. More data are required to further develop and validate this decision rule. Conclusions: An optimal decision rule can provide improved data adaptive treatment decisions that balance benefit and risk outcomes given a maximum acceptable risk.
- 1 June 2025
- Published by Institute of Mathematical Statistics in The Annals of Applied Statistics
- Vol. 19 (2) , 847-865
Sensitivity analysis and power in the presence of many weak instruments: Application to the effect of incarceration on future earnings
This article discusses a sensitivity analysis for an instrumental variable (IV) estimate in the presence of many instruments that are weakly associated with the endogenous variable. We study the effect of imprisonment on earnings using data on individuals sentenced for felony in Michigan in the years 2003–2006. Motivated by the random assignment of judges to cases, we construct a vector of instruments based on judges’ ID. Our data has two important features that cannot be handled using standard IV approaches. First, while some judges exhibit strong tendencies toward a prison or nonprison sentence, many judges do not have strong tendencies toward a particular sentence type. Second, our data includes only cases that result in sentencing, and thus the standard analyses are subject to selection bias. We develop a sensitivity analysis procedure that is robust to the presence of many weak instruments and quantifies the effect of the selection bias on the parameter of interest. A power formula for the sensitivity analysis is also provided. Analyses show that being sentenced to prison significantly reduces the offenders’ earnings. Our simulation studies highlight the value of the proposed method in terms of statistical power and also confirm the validity of our power formula.
- 1 June 2025
- Published by Institute of Mathematical Statistics in The Annals of Applied Statistics
- Vol. 19 (2) , 847-865
Sensitivity analysis and power in the presence of many weak instruments: Application to the effect of incarceration on future earnings
This article discusses a sensitivity analysis for an instrumental variable (IV) estimate in the presence of many instruments that are weakly associated with the endogenous variable. We study the effect of imprisonment on earnings using data on individuals sentenced for felony in Michigan in the years 2003–2006. Motivated by the random assignment of judges to cases, we construct a vector of instruments based on judges’ ID. Our data has two important features that cannot be handled using standard IV approaches. First, while some judges exhibit strong tendencies toward a prison or nonprison sentence, many judges do not have strong tendencies toward a particular sentence type. Second, our data includes only cases that result in sentencing, and thus the standard analyses are subject to selection bias. We develop a sensitivity analysis procedure that is robust to the presence of many weak instruments and quantifies the effect of the selection bias on the parameter of interest. A power formula for the sensitivity analysis is also provided. Analyses show that being sentenced to prison significantly reduces the offenders’ earnings. Our simulation studies highlight the value of the proposed method in terms of statistical power and also confirm the validity of our power formula.
- 2 April 2025
- Published by Oxford University Press (OUP) in Biometrics
- Vol. 81 (2)
Nonparametric assessment of regimen response curve estimators
In the framework of dynamic marginal structural models, regimen-response curve is a function that describes the relation between the mean outcome and the parameters in the class of decision rules. The modeling choice of the regimen-response curve is crucial in constructing an optimal regime, as a misspecified model can lead to a biased estimate with questionable causal interpretability. However, the existing literature lacks methods to evaluate and compare different working models. To address this problem, we will leverage risk to assess the “goodness-of-fit” of an imposed working model. We consider the counterfactual risk as our target parameter and derive inverse probability weighting and canonical gradients to map it to the observed data. We provide asymptotic properties of the resulting risk estimators, considering both fixed and data-dependent target parameters. We will show that the inverse probability weighting estimator can be efficient and asymptotic linear when the weight functions are estimated using a sieve-based estimator. The proposed method is implemented on the LS1 study to estimate a regimen-response curve for patients with Parkinson’s disease.
- 2 April 2025
- Published by Oxford University Press (OUP) in Biometrics
- Vol. 81 (2)
Nonparametric assessment of regimen response curve estimators
In the framework of dynamic marginal structural models, regimen-response curve is a function that describes the relation between the mean outcome and the parameters in the class of decision rules. The modeling choice of the regimen-response curve is crucial in constructing an optimal regime, as a misspecified model can lead to a biased estimate with questionable causal interpretability. However, the existing literature lacks methods to evaluate and compare different working models. To address this problem, we will leverage risk to assess the “goodness-of-fit” of an imposed working model. We consider the counterfactual risk as our target parameter and derive inverse probability weighting and canonical gradients to map it to the observed data. We provide asymptotic properties of the resulting risk estimators, considering both fixed and data-dependent target parameters. We will show that the inverse probability weighting estimator can be efficient and asymptotic linear when the weight functions are estimated using a sieve-based estimator. The proposed method is implemented on the LS1 study to estimate a regimen-response curve for patients with Parkinson’s disease.
- Open Access
- 7 January 2025
- Published by Oxford University Press (OUP) in Biometrics
- Vol. 81 (1)
Penalized G-estimation for effect modifier selection in a structural nested mean model for repeated outcomes
Effect modification occurs when the impact of the treatment on an outcome varies based on the levels of other covariates known as effect modifiers. Modeling these effect differences is important for etiological goals and for purposes of optimizing treatment. Structural nested mean models (SNMMs) are useful causal models for estimating the potentially heterogeneous effect of a time-varying exposure on the mean of an outcome in the presence of time-varying confounding. A data-adaptive selection approach is necessary if the effect modifiers are unknown a priori and need to be identified. Although variable selection techniques are available for estimating the conditional average treatment effects using marginal structural models or for developing optimal dynamic treatment regimens, all of these methods consider a single end-of-follow-up outcome. In the context of an SNMM for repeated outcomes, we propose a doubly robust penalized G-estimator for the causal effect of a time-varying exposure with a simultaneous selection of effect modifiers and prove the oracle property of our estimator. We conduct a simulation study for the evaluation of its performance in finite samples and verification of its double-robustness property. Our work is motivated by the study of hemodiafiltration for treating patients with end-stage renal disease at the Centre Hospitalier de l’Université de Montréal. We apply the proposed method to investigate the effect heterogeneity of dialysis facility on the repeated session-specific hemodiafiltration outcomes.
- 7 January 2025
- Published by Oxford University Press (OUP) in Biometrics
- Vol. 81 (1)
Open AccessPenalized G-estimation for effect modifier selection in a structural nested mean model for repeated outcomes
Effect modification occurs when the impact of the treatment on an outcome varies based on the levels of other covariates known as effect modifiers. Modeling these effect differences is important for etiological goals and for purposes of optimizing treatment. Structural nested mean models (SNMMs) are useful causal models for estimating the potentially heterogeneous effect of a time-varying exposure on the mean of an outcome in the presence of time-varying confounding. A data-adaptive selection approach is necessary if the effect modifiers are unknown a priori and need to be identified. Although variable selection techniques are available for estimating the conditional average treatment effects using marginal structural models or for developing optimal dynamic treatment regimens, all of these methods consider a single end-of-follow-up outcome. In the context of an SNMM for repeated outcomes, we propose a doubly robust penalized G-estimator for the causal effect of a time-varying exposure with a simultaneous selection of effect modifiers and prove the oracle property of our estimator. We conduct a simulation study for the evaluation of its performance in finite samples and verification of its double-robustness property. Our work is motivated by the study of hemodiafiltration for treating patients with end-stage renal disease at the Centre Hospitalier de l’Université de Montréal. We apply the proposed method to investigate the effect heterogeneity of dialysis facility on the repeated session-specific hemodiafiltration outcomes.
- Open Access
- 6 December 2024
- Published by JMIR Publications Inc. in JMIR Mental Health
- Vol. 11 (1) , e56407
Text Messaging to Extend School-Based Suicide Prevention: Pilot Randomized Controlled Trial
Background: Suicide is the third-leading cause of death among US adolescents aged 10-19 years, and about 10% attempt suicide each year. School-based universal prevention may reduce youth suicidal behavior. Sources of Strength uses a peer leader network diffusion model to promote healthy norms across a school population. A key challenge within schoolwide programs is reaching a large and diverse array of students, especially those less engaged with their peers. Motivated by this challenge, we developed and field-tested Text4Strength—a program of automated text messages targeting help-seeking attitudes and norms, social coping resources, and emotion regulation skills. Objective: This study conducted a pilot randomized controlled trial of Text4Strength in 1 high school as an extension of an ongoing schoolwide program (Sources of Strength), to test its impact on targets that have the potential to reduce suicidal behavior. Methods: Students at an upstate New York high school (N=223) received 1-2 text messages per week for 9 weeks, targeting strategies for coping with difficult feelings and experiences through clarifying emotions and focusing on positive affect concepts, awareness, and strengthening of youth-adult relationships; and positive help-seeking norms, skills, and resources. Surveys were administered at baseline, immediately post intervention and 3 months after texting ended. We measured proximal intervention targets (methods of coping during stressful events, ability to make sense of their own emotions, feelings of powerlessness during emotion management and recovery, relations with trusted adults at school, and help-seeking behaviors), symptoms and suicide ideation, and student replies to messages. Results: No significant effects were observed for any outcome at either follow-up time point. Results showed that if there is a true (but undetected) intervention effect, it is small. Students with fewer friend nominations did not interact any more or less with the text messages. Exploratory moderation analyses observed no interaction between the intervention condition and the number of friends or baseline suicide ideation at any time point. Conclusions: In contrast to a promising previous field test, these results suggest that Text4Strength is unlikely to have impacted the outcomes of interest and that undetected moderate or large effects can be ruled out with high confidence. Although motivated by the need to reach more isolated students, students with fewer friends did not engage more or show a greater effect than other participants. This study was conducted in a single high school that was already implementing Sources of Strength, so the bar for showing a distinct effect from texting alone was high. Many further channels for reaching youth through private messaging remain unexplored. Alternative delivery systems should be investigated, such as embedding messaging in gaming chat systems and other media. More sophisticated systems drawing on chatbots may also achieve better outcomes. Trial Registration: ClinicalTrials.gov NCT03145363; https://clinicaltrials.gov/study/NCT03145363
- 6 December 2024
- Published by JMIR Publications Inc. in JMIR Mental Health
- Vol. 11 (1) , e56407
Open AccessText Messaging to Extend School-Based Suicide Prevention: Pilot Randomized Controlled Trial
Background: Suicide is the third-leading cause of death among US adolescents aged 10-19 years, and about 10% attempt suicide each year. School-based universal prevention may reduce youth suicidal behavior. Sources of Strength uses a peer leader network diffusion model to promote healthy norms across a school population. A key challenge within schoolwide programs is reaching a large and diverse array of students, especially those less engaged with their peers. Motivated by this challenge, we developed and field-tested Text4Strength—a program of automated text messages targeting help-seeking attitudes and norms, social coping resources, and emotion regulation skills. Objective: This study conducted a pilot randomized controlled trial of Text4Strength in 1 high school as an extension of an ongoing schoolwide program (Sources of Strength), to test its impact on targets that have the potential to reduce suicidal behavior. Methods: Students at an upstate New York high school (N=223) received 1-2 text messages per week for 9 weeks, targeting strategies for coping with difficult feelings and experiences through clarifying emotions and focusing on positive affect concepts, awareness, and strengthening of youth-adult relationships; and positive help-seeking norms, skills, and resources. Surveys were administered at baseline, immediately post intervention and 3 months after texting ended. We measured proximal intervention targets (methods of coping during stressful events, ability to make sense of their own emotions, feelings of powerlessness during emotion management and recovery, relations with trusted adults at school, and help-seeking behaviors), symptoms and suicide ideation, and student replies to messages. Results: No significant effects were observed for any outcome at either follow-up time point. Results showed that if there is a true (but undetected) intervention effect, it is small. Students with fewer friend nominations did not interact any more or less with the text messages. Exploratory moderation analyses observed no interaction between the intervention condition and the number of friends or baseline suicide ideation at any time point. Conclusions: In contrast to a promising previous field test, these results suggest that Text4Strength is unlikely to have impacted the outcomes of interest and that undetected moderate or large effects can be ruled out with high confidence. Although motivated by the need to reach more isolated students, students with fewer friends did not engage more or show a greater effect than other participants. This study was conducted in a single high school that was already implementing Sources of Strength, so the bar for showing a distinct effect from texting alone was high. Many further channels for reaching youth through private messaging remain unexplored. Alternative delivery systems should be investigated, such as embedding messaging in gaming chat systems and other media. More sophisticated systems drawing on chatbots may also achieve better outcomes. Trial Registration: ClinicalTrials.gov NCT03145363; https://clinicaltrials.gov/study/NCT03145363
- Open Access
- 28 November 2024
- Published by Oxford University Press (OUP) in Journal of the Royal Statistical Society Series B: Statistical Methodology
- Vol. 87 (3) , 678-700
Causal mediation analysis: selection with asymptotically valid inference
Researchers are often interested in learning not only the effect of treatments on outcomes, but also the mechanisms that transmit these effects. A mediator is a variable that is affected by treatment and subsequently affects outcome. Existing methods for penalized mediation analyses may lead to ignoring important mediators and either assume that finite-dimensional linear models are sufficient to remove confounding bias, or perform no confounding control at all. In practice, these assumptions may not hold. We propose a method that considers the confounding functions as nuisance parameters to be estimated using data-adaptive methods. We then use a novel regularization method applied to this objective function to identify a set of important mediators. We consider natural direct and indirect effects as our target parameters. We then proceed to derive the asymptotic properties of our estimators and establish the oracle property under specific assumptions. Asymptotic results are also presented in a local setting, which contrast the proposal with the standard adaptive lasso. We also propose a perturbation bootstrap technique to provide asymptotically valid postselection inference for the mediated effects of interest. The performance of these methods will be discussed and demonstrated through simulation studies.
- 28 November 2024
- Published by Oxford University Press (OUP) in Journal of the Royal Statistical Society Series B: Statistical Methodology
- Vol. 87 (3) , 678-700
Open AccessCausal mediation analysis: selection with asymptotically valid inference
Researchers are often interested in learning not only the effect of treatments on outcomes, but also the mechanisms that transmit these effects. A mediator is a variable that is affected by treatment and subsequently affects outcome. Existing methods for penalized mediation analyses may lead to ignoring important mediators and either assume that finite-dimensional linear models are sufficient to remove confounding bias, or perform no confounding control at all. In practice, these assumptions may not hold. We propose a method that considers the confounding functions as nuisance parameters to be estimated using data-adaptive methods. We then use a novel regularization method applied to this objective function to identify a set of important mediators. We consider natural direct and indirect effects as our target parameters. We then proceed to derive the asymptotic properties of our estimators and establish the oracle property under specific assumptions. Asymptotic results are also presented in a local setting, which contrast the proposal with the standard adaptive lasso. We also propose a perturbation bootstrap technique to provide asymptotically valid postselection inference for the mediated effects of interest. The performance of these methods will be discussed and demonstrated through simulation studies.
- 1 June 2024
- Published by Institute of Mathematical Statistics in The Annals of Applied Statistics
- Vol. 18 (2) , 905-921
A marginal structural model for partial compliance in SMARTs
The cyclical and heterogeneous nature of many substance use disorders highlights the need to adapt the type and/or the dose of treatment to accommodate the specific and changing needs of individuals. The Adaptive Treatment for Alcohol and Cocaine Dependence study (ENGAGE) is a sequential multiple assignment randomized trial (SMART) that provided longitudinal data for constructing dynamic treatment regimes (DTRs) to improve patients’ engagement in therapy. However, the high rate of noncompliance and lack of analytic tools to account for noncompliance has impeded researchers from using the data to achieve the main goal of the trial; namely, construction of individually tailored DTRs. We address this by defining our target parameter as the mean outcome under different DTRs for potential compliance strata and propose a marginal structural model with principal stratification to estimate this quantity. We model the principal strata using a Bayesian semiparametric approach. An important feature of our work is that we consider partial rather than binary compliance strata, which is more relevant in longitudinal studies. We assess the performance of our method through simulation. We illustrate its application on ENGAGE and demonstrate the optimal DTRs depend on compliance strata compared with ignoring compliance information as in intention-to-treat analyses.
- 1 June 2024
- Published by Institute of Mathematical Statistics in The Annals of Applied Statistics
- Vol. 18 (2) , 905-921
A marginal structural model for partial compliance in SMARTs
The cyclical and heterogeneous nature of many substance use disorders highlights the need to adapt the type and/or the dose of treatment to accommodate the specific and changing needs of individuals. The Adaptive Treatment for Alcohol and Cocaine Dependence study (ENGAGE) is a sequential multiple assignment randomized trial (SMART) that provided longitudinal data for constructing dynamic treatment regimes (DTRs) to improve patients’ engagement in therapy. However, the high rate of noncompliance and lack of analytic tools to account for noncompliance has impeded researchers from using the data to achieve the main goal of the trial; namely, construction of individually tailored DTRs. We address this by defining our target parameter as the mean outcome under different DTRs for potential compliance strata and propose a marginal structural model with principal stratification to estimate this quantity. We model the principal strata using a Bayesian semiparametric approach. An important feature of our work is that we consider partial rather than binary compliance strata, which is more relevant in longitudinal studies. We assess the performance of our method through simulation. We illustrate its application on ENGAGE and demonstrate the optimal DTRs depend on compliance strata compared with ignoring compliance information as in intention-to-treat analyses.
- Open Access
- 27 May 2024
- Published by JMIR Publications Inc. in JMIR Preprints
Text Messaging to Extend School-Based Suicide Prevention: Pilot Randomized Controlled Trial (Preprint)
BACKGROUND Suicide is the third-leading cause of death among US adolescents aged 10-19 years, and about 10% attempt suicide each year. School-based universal prevention may reduce youth suicidal behavior. Sources of Strength uses a peer leader network diffusion model to promote healthy norms across a school population. A key challenge within schoolwide programs is reaching a large and diverse array of students, especially those less engaged with their peers. Motivated by this challenge, we developed and field-tested Text4Strength—a program of automated text messages targeting help-seeking attitudes and norms, social coping resources, and emotion regulation skills. OBJECTIVE This study conducted a pilot randomized controlled trial of Text4Strength in 1 high school as an extension of an ongoing schoolwide program (Sources of Strength), to test its impact on targets that have the potential to reduce suicidal behavior. METHODS Students at an upstate New York high school (N=223) received 1-2 text messages per week for 9 weeks, targeting strategies for coping with difficult feelings and experiences through clarifying emotions and focusing on positive affect concepts, awareness, and strengthening of youth-adult relationships; and positive help-seeking norms, skills, and resources. Surveys were administered at baseline, immediately post intervention and 3 months after texting ended. We measured proximal intervention targets (methods of coping during stressful events, ability to make sense of their own emotions, feelings of powerlessness during emotion management and recovery, relations with trusted adults at school, and help-seeking behaviors), symptoms and suicide ideation, and student replies to messages. RESULTS No significant effects were observed for any outcome at either follow-up time point. Results showed that if there is a true (but undetected) intervention effect, it is small. Students with fewer friend nominations did not interact any more or less with the text messages. Exploratory moderation analyses observed no interaction between the intervention condition and the number of friends or baseline suicide ideation at any time point. CONCLUSIONS In contrast to a promising previous field test, these results suggest that Text4Strength is unlikely to have impacted the outcomes of interest and that undetected moderate or large effects can be ruled out with high confidence. Although motivated by the need to reach more isolated students, students with fewer friends did not engage more or show a greater effect than other participants. This study was conducted in a single high school that was already implementing Sources of Strength, so the bar for showing a distinct effect from texting alone was high. Many further channels for reaching youth through private messaging remain unexplored. Alternative delivery systems should be investigated, such as embedding messaging in gaming chat systems and other media. More sophisticated systems drawing on chatbots may also achieve better outcomes. CLINICALTRIAL ClinicalTrials.gov NCT03145363; https://clinicaltrials.gov/study/NCT03145363
- 27 May 2024
- Published by JMIR Publications Inc. in JMIR Preprints
Open AccessText Messaging to Extend School-Based Suicide Prevention: Pilot Randomized Controlled Trial (Preprint)
BACKGROUND Suicide is the third-leading cause of death among US adolescents aged 10-19 years, and about 10% attempt suicide each year. School-based universal prevention may reduce youth suicidal behavior. Sources of Strength uses a peer leader network diffusion model to promote healthy norms across a school population. A key challenge within schoolwide programs is reaching a large and diverse array of students, especially those less engaged with their peers. Motivated by this challenge, we developed and field-tested Text4Strength—a program of automated text messages targeting help-seeking attitudes and norms, social coping resources, and emotion regulation skills. OBJECTIVE This study conducted a pilot randomized controlled trial of Text4Strength in 1 high school as an extension of an ongoing schoolwide program (Sources of Strength), to test its impact on targets that have the potential to reduce suicidal behavior. METHODS Students at an upstate New York high school (N=223) received 1-2 text messages per week for 9 weeks, targeting strategies for coping with difficult feelings and experiences through clarifying emotions and focusing on positive affect concepts, awareness, and strengthening of youth-adult relationships; and positive help-seeking norms, skills, and resources. Surveys were administered at baseline, immediately post intervention and 3 months after texting ended. We measured proximal intervention targets (methods of coping during stressful events, ability to make sense of their own emotions, feelings of powerlessness during emotion management and recovery, relations with trusted adults at school, and help-seeking behaviors), symptoms and suicide ideation, and student replies to messages. RESULTS No significant effects were observed for any outcome at either follow-up time point. Results showed that if there is a true (but undetected) intervention effect, it is small. Students with fewer friend nominations did not interact any more or less with the text messages. Exploratory moderation analyses observed no interaction between the intervention condition and the number of friends or baseline suicide ideation at any time point. CONCLUSIONS In contrast to a promising previous field test, these results suggest that Text4Strength is unlikely to have impacted the outcomes of interest and that undetected moderate or large effects can be ruled out with high confidence. Although motivated by the need to reach more isolated students, students with fewer friends did not engage more or show a greater effect than other participants. This study was conducted in a single high school that was already implementing Sources of Strength, so the bar for showing a distinct effect from texting alone was high. Many further channels for reaching youth through private messaging remain unexplored. Alternative delivery systems should be investigated, such as embedding messaging in gaming chat systems and other media. More sophisticated systems drawing on chatbots may also achieve better outcomes. CLINICALTRIAL ClinicalTrials.gov NCT03145363; https://clinicaltrials.gov/study/NCT03145363
- Open Access
- 1 January 2024
- Published by Institute of Mathematical Statistics in Electronic Journal of Statistics
- Vol. 18 (2) , 5132-5155
Structural mean models for instrumented difference-in-differences
In the standard difference-in-differences research design, the parallel trend assumption can be violated when the effect of some unmeasured confounders on the outcome trend is different between the treated and untreated populations. Progress can be made if there is an exogenous variable that (i) does not directly influence the change in outcome (i.e. the outcome trend) except through influencing the change in exposure (i.e. the exposure trend), and (ii) is not related to the unmeasured exposure - outcome confounders on the trend scale. Such exogenous variable is called an instrument for difference-in-differences. For continuous outcomes that lend themselves to linear modelling, so-called instrumented difference-in-differences methods have been proposed. In this paper, we will suggest novel multiplicative structural mean models for instrumented difference-in-differences, which allow one to identify and estimate the average treatment effect that is stable over time on the multiplicative scale, in the whole population or among the treated, when (i) a valid instrument for difference-in-differences is available and (ii) there is no carry-over effect across periods. We discuss the identifiability of these models, then develop efficient semi-parametric estimation approaches that allow the use of flexible, data-adaptive or machine learning methods to estimate the nuisance parameters. We apply our proposal on health care data to investigate the risk of moderate to severe weight gain under sulfonylurea treatment compared to metformin treatment, among new users of antihyperglycemic drugs.
- 1 January 2024
- Published by Institute of Mathematical Statistics in Electronic Journal of Statistics
- Vol. 18 (2) , 5132-5155
Open AccessStructural mean models for instrumented difference-in-differences
In the standard difference-in-differences research design, the parallel trend assumption can be violated when the effect of some unmeasured confounders on the outcome trend is different between the treated and untreated populations. Progress can be made if there is an exogenous variable that (i) does not directly influence the change in outcome (i.e. the outcome trend) except through influencing the change in exposure (i.e. the exposure trend), and (ii) is not related to the unmeasured exposure - outcome confounders on the trend scale. Such exogenous variable is called an instrument for difference-in-differences. For continuous outcomes that lend themselves to linear modelling, so-called instrumented difference-in-differences methods have been proposed. In this paper, we will suggest novel multiplicative structural mean models for instrumented difference-in-differences, which allow one to identify and estimate the average treatment effect that is stable over time on the multiplicative scale, in the whole population or among the treated, when (i) a valid instrument for difference-in-differences is available and (ii) there is no carry-over effect across periods. We discuss the identifiability of these models, then develop efficient semi-parametric estimation approaches that allow the use of flexible, data-adaptive or machine learning methods to estimate the nuisance parameters. We apply our proposal on health care data to investigate the risk of moderate to severe weight gain under sulfonylurea treatment compared to metformin treatment, among new users of antihyperglycemic drugs.