Assessing heterogeneous causal effects across clusters in partially nested designs.
Author:
- 30 December 2024
- journal article
- research article
- Published by American Psychological Association (APA) in Psychological Methods
Abstract
Intervention studies in psychology often have a partially nested design (PND): after individuals are assigned to study arms, individuals in a treatment arm are subsequently assigned to clusters (e.g., therapists/therapy groups) to receive treatment, whereas individuals in a control arm are unclustered. Given the presence of clustering in the treatment arm, it can be of interest to examine the heterogeneity of treatment effects across the clusters; but this is challenging in PNDs. First, in defining a causal effect of treatment for a specific cluster, it is unclear how the treatment and control outcomes should be compared, as the clustering is absent in the control arm. Although it may be tempting to compare outcomes between a specific cluster and the entire control arm, this crude comparison may not represent a causal effect even in PNDs with randomized treatment assignments, as the cluster assignment may be nonrandomized (elaborated in this study). In this study, we develop methods to define, identify, and estimate the causal effects of treatment across specific clusters in a PND where the treatment and/or cluster assignment may be nonrandomized. Using the principal stratification approach and potential outcomes framework, we define causal estimands for the cluster-specific treatment effects in two scenarios: (a) no-interference and (b) within-cluster interference. We identify the effects under the principal ignorability assumption. For estimation, we provide a multiply-robust method that can protect against misspecification in a nuisance model and can incorporate machine learning methods in the nuisance model estimation. We evaluate the estimators' performance through simulations and illustrate the application using an empirical PND example. (PsycInfo Database Record (c) 2025 APA, all rights reserved).Keywords
This publication has 77 references indexed in Scilit:
- Using principal stratification in analysis of clinical trialsStatistics in Medicine, 2022
- Propensity score methods for observational studies with clustered data: A reviewStatistics in Medicine, 2022
- A flexible, interpretable framework for assessing sensitivity to unmeasured confoundingStatistics in Medicine, 2016
- The fragility of standard inferential approaches in principal stratification models relative to direct likelihood approachesStatistical Analysis and Data Mining: An ASA Data Science Journal, 2015
- Moving towards best practice when using inverse probability of treatment weighting (IPTW) using the propensity score to estimate causal treatment effects in observational studiesStatistics in Medicine, 2015
- Estimation of the effect of interventions that modify the received treatmentStatistics in Medicine, 2013
- Propensity score weighting with multilevel dataStatistics in Medicine, 2013
- Targeted Learning2011
- On the use of propensity scores in principal causal effect estimationStatistics in Medicine, 2009
- Differential effects of high‐quality child careJournal of Policy Analysis and Management, 2002