PSPeter Z. Schochet

Peter Z. Schochet

*This is an algorithmically generated author record based on publicly available information.

Peter Z. Schochet has a total of 11 co-authors. Here are the top co-authors by number of shared publications:


Latest Publications

  • Open Access

    Design-Based Estimation and Central Limit Theorems for Local Average Treatment Effects for RCTs

    by Peter Z Schochet

    There is a growing literature on design-based methods to estimate average treatment effects for randomized controlled trials (RCTs) using the underpinnings of experiments. In this article, we build on these methods to consider design-based regression estimators for the local average treatment effect (LATE) estimand for RCTs with treatment noncompliance. We prove new finite-population central limit theorems for a range of designs, including blocked and clustered RCTs, allowing for baseline covariates to improve precision. We discuss consistent variance estimators based on model residuals and conduct simulations that show the estimators yield confidence interval coverage near nominal levels. We demonstrate the methods using data from a private school voucher RCT in New York City USA.

  • Open Access

    Design-based RCT estimators and central limit theorems for baseline subgroup and related analyses

    by Peter Z. Schochet

    There is a growing literature on design-based (DB) methods to estimate average treatment effects (ATEs) for randomized controlled trials (RCTs) for full sample analyses. This article extends these methods to estimate ATEs for discrete subgroups defined by pre-treatment variables, with an application to an RCT testing subgroup effects for a school voucher experiment in New York City. We consider ratio estimators for subgroup effects using regression methods, allowing for model covariates to improve precision, and prove a new finite population central limit theorem. We discuss extensions to blocked and clustered RCT designs, and to other common estimators with random treatment-control sample sizes or summed weights: post-stratification estimators, weighted estimators that adjust for data nonresponse, and estimators for Bernoulli trials. We also develop simple variance estimators that share features with robust estimators. Simulations show that the DB subgroup estimators yield confidence interval coverage near nominal levels, even for small subgroups.


  • Estimating average treatment effects for clustered RCTs with recruitment bias

    by Peter Z. Schochet

    In clustered randomized controlled trials (RCTs), sample recruitment is often conducted after cluster randomization. This timing can lead to recruitment bias if access to the intervention affects the composition of study‐eligible cluster entrants and study consenters. This article develops a potential outcomes framework in such settings that yields a causal estimand that pertains to the always‐recruited in either research condition. A consistent inverse probability weighting (IPW) estimator is developed using data on recruits only, and a generalized estimating equations approach is used to obtain robust clustered SE estimators that adjust for estimation error in the IPW weights. A simple data collection strategy is discussed to improve the predictive accuracy of the logit propensity score models. Simulations show that the IPW estimator achieves nominal confidence interval coverage under the assumed identification conditions. An empirical application demonstrates the methods using data from an RCT testing the effects of a behavioral health intervention in schools. An R program for estimation is available for download.


  • Open Access

    Design-Based RCT Estimators and Central Limit Theorems for Baseline Subgroup and Related Analyses

    by Peter Z. Schochet

    There is a growing literature on design-based methods to estimate average treatment effects (ATEs) for randomized controlled trials (RCTs) for full sample analyses. This article extends these methods to estimate ATEs for discrete subgroups defined by pre-treatment variables, with an application to an RCT testing subgroup effects for a school voucher experiment in New York City. We consider ratio estimators for subgroup effects using regression methods, allowing for model covariates to improve precision, and prove a finite population central limit theorem. We discuss extensions to blocked and clustered RCT designs, and to other common estimators with random treatment-control sample sizes (or weights): post-stratification estimators, weighted estimators that adjust for data nonresponse, and estimators for Bernoulli trials. We also develop simple variance estimators that share features with robust estimators. Simulations show that the design-based subgroup estimators yield confidence interval coverage near nominal levels, even for small subgroups.

  • Open Access

    Estimating Complier Average Causal Effects for Clustered RCTs When the Treatment Affects the Service Population

    by Peter Z. Schochet

    RCTs sometimes test interventions that aim to improve existing services targeted to a subset of individuals identified after randomization. Accordingly, the treatment could affect the composition of service recipients and the offered services. With such bias, intention-to-treat estimates using data on service recipients and nonrecipients may be difficult to interpret. This article develops causal estimands and inverse probability weighting (IPW) estimators for complier populations in these settings, using a generalized estimating equation approach that adjusts the standard errors for estimation error in the IPW weights. While our focus is on more general clustered RCTs, the methods also apply (reduce) to non-clustered RCTs. Simulations show that the estimators achieve nominal confidence interval coverage under the assumed identification conditions. An empirical application demonstrates the methods using data from a large-scale RCT testing the effects of early childhood services on children's cognitive development scores.

  • Open Access

    A Lasso approach to covariate selection and average treatment effect estimation for clustered RCTs using design-based methods

    by Peter Z. Schochet

    Statistical power is often a concern for clustered randomized control trials (RCTs) due to variance inflation from design effects and the high cost of adding study clusters (such as hospitals, schools, or communities). While covariate pre-specification can improve power for estimating regression-adjusted average treatment effects (ATEs), further precision gains can be achieved through covariate selection once primary outcomes have been collected. This article uses design-based methods underlying clustered RCTs to develop Lasso methods for the post-hoc selection of covariates for ATE estimation that avoids a lack of transparency and model overfitting. Our focus is on two-stage estimators: in the first stage, Lasso estimation is conducted using data on cluster-level averages or sums, and in the second stage, standard ATE estimators are adjusted for covariates using the first-stage Lasso results. We discuss l 1 consistency of the estimated Lasso coefficients, asymptotic normality of the ATE estimators, and design-based variance estimation. The nonparametric approach applies to continuous, binary, and discrete outcomes. We present simulation results and demonstrate the method using data from a federally funded clustered RCT testing the effects of school-based programs promoting behavioral health.


  • Open Access

    Estimating complier average causal effects for clustered RCTs when the treatment affects the service population

    by Peter Z. Schochet

    Randomized controlled trials (RCTs) sometimes test interventions that aim to improve existing services targeted to a subset of individuals identified after randomization. Accordingly, the treatment could affect the composition of service recipients and the offered services. With such bias, intention-to-treat estimates using data on service recipients and nonrecipients may be difficult to interpret. This article develops causal estimands and inverse probability weighting (IPW) estimators for complier populations in these settings, using a generalized estimating equation approach that adjusts the standard errors for estimation error in the IPW weights. While our focus is on more general clustered RCTs, the methods also apply (reduce) to nonclustered RCTs. Simulations show that the estimators achieve nominal confidence interval coverage under the assumed identification conditions. An empirical application demonstrates the methods using data from a large-scale RCT testing the effects of early childhood services on children’s cognitive development scores. An R program for estimation is available for download.


  • Open Access

    Statistical Power for Estimating Treatment Effects Using Difference-in-Differences and Comparative Interrupted Time Series Designs with Variation in Treatment Timing

    by Peter Z. Schochet

    This article develops new closed-form variance expressions for power analyses for commonly used difference-in-differences (DID) and comparative interrupted time series (CITS) panel data estimators. The main contribution is to incorporate variation in treatment timing into the analysis. The power formulas also account for other key design features that arise in practice: autocorrelated errors, unequal measurement intervals, and clustering due to the unit of treatment assignment. We consider power formulas for both cross-sectional and longitudinal models and allow for covariates. An illustrative power analysis provides guidance on appropriate sample sizes. The key finding is that accounting for treatment timing increases required sample sizes. Further, DID estimators have considerably more power than standard CITS and ITS estimators. An available Shiny R dashboard performs the sample size calculations for the considered estimators.

  • Design-Based Ratio Estimators and Central Limit Theorems for Clustered, Blocked RCTs

    by Peter Z. Schochet, Nicole E. Pashley, Luke W. Miratrix, Tim Kautz

    This article develops design-based ratio estimators for clustered, blocked randomized controlled trials (RCTs), with an application to a federally funded, school-based RCT testing the effects of behavioral health interventions. We consider finite population weighted least squares estimators for average treatment effects (ATEs), allowing for general weighting schemes and covariates. We consider models with block-by-treatment status interactions as well as restricted models with block indicators only. We prove new finite population central limit theorems for each block specification. We also discuss simple variance estimators that share features with commonly used cluster-robust standard error estimators. Simulations show that the design-based ATE estimator yields nominal rejection rates with standard errors near true ones, even with few clusters.


  • The Effects of Employment Counseling on Labor Market Outcomes for Adults and Dislocated Workers: Evidence from a Nationally Representative Experiment

    by Sheena McConnell, Peter Z. Schochet, Dana Rotz, Ken Fortson, Paul Burkander, Annalisa Mastri

    This article examines the effects of “intensive services” provided by the Adult and Dislocated Worker programs, two of the largest employment service programs in the United States. Intensive services include one‐on‐one staff assistance—assessments, coaching, career counseling, and service referrals. The study was a randomized controlled trial conducted in 28 randomly selected sites, with the randomization of job seekers to research groups with or without access to intensive services, yielding study findings with both internal and external validity. Using survey and administrative earnings data, we find that access to intensive services increased earnings by between 7 and 20 percent over a three‐year follow‐up period; these benefits exceed program costs from the perspective of both taxpayers and society as a whole. Although impacts were larger for more educated job seekers and in areas with higher rates of unemployment, impacts were similar across many other subgroups, including for adults compared with dislocated workers.