Jessaca Spybrook
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Jessaca Spybrook has a total of 38 co-authors. Here are the top co-authors by number of shared publications:
- Nianbo Dong
University of North Carolina at Chapel Hill
7 shared publications Benjamin Kelcey
University of Cincinnati, Cincinnati, OH, USA
6 shared publications- Wei Li
College of Education, University of Florida, Gainesville, USA
4 shared publications - Rebecca Maynard
University of Pennsylvania
3 shared publications - Benjamin Kelcey
University of Cincinnati
2 shared publications Dung Pham
College of Agricultural & Environmental Sciences, University of Georgia
2 shared publications
Latest Publications
- 25 July 2025
- Published by Elsevier in Journal of School Psychology
- Vol. 111, 101473
A practical guide to causal moderation analysis for investigating the role of context, identity, and culture in intervention research
- 25 July 2025
- Published by Elsevier in Journal of School Psychology
- Vol. 111, 101473
A practical guide to causal moderation analysis for investigating the role of context, identity, and culture in intervention research
- Open Access
- 1 January 2025
- Published by SAGE Publications in AERA Open
- Vol. 11
Improving the Design of Evaluations that Include Students, Teachers, and Schools: An Empirical Investigation of Key Design Parameters
The learning environment is a complex environment for conducting evaluations. Students, teachers, and schools all play a role in shaping the environment, which can lead to differences in student achievement. Hence designing an evaluation with the capacity to detect the effectiveness of an educational intervention on student achievement requires careful planning. A key part of the planning is a statistical power analysis that considers the multilevel nature of the design. This study provides empirical estimates of design parameters necessary for planning adequately powered cluster randomized trials that include the student, teacher, and school level and are focused on reading, mathematics, or science achievement. The sample in our study includes administrative state datasets from Michigan, North Carolina, Kentucky, and Maryland for grades 3 through 8. The results showed that, with few exceptions, the variance in student test scores is larger between teachers within schools than between schools.
- 1 January 2025
- Published by SAGE Publications in AERA Open
- Vol. 11
Open AccessImproving the Design of Evaluations that Include Students, Teachers, and Schools: An Empirical Investigation of Key Design Parameters
The learning environment is a complex environment for conducting evaluations. Students, teachers, and schools all play a role in shaping the environment, which can lead to differences in student achievement. Hence designing an evaluation with the capacity to detect the effectiveness of an educational intervention on student achievement requires careful planning. A key part of the planning is a statistical power analysis that considers the multilevel nature of the design. This study provides empirical estimates of design parameters necessary for planning adequately powered cluster randomized trials that include the student, teacher, and school level and are focused on reading, mathematics, or science achievement. The sample in our study includes administrative state datasets from Michigan, North Carolina, Kentucky, and Maryland for grades 3 through 8. The results showed that, with few exceptions, the variance in student test scores is larger between teachers within schools than between schools.
- Open Access
- 19 September 2024
- Published by Taylor & Francis in Journal of Research on Educational Effectiveness
- Vol. 18 (4) , 951-979
Advantages of Monte Carlo Confidence Intervals for Incremental Cost-Effectiveness Ratios: A Comparison of Five Methods
- 19 September 2024
- Published by Taylor & Francis in Journal of Research on Educational Effectiveness
- Vol. 18 (4) , 951-979
Open AccessAdvantages of Monte Carlo Confidence Intervals for Incremental Cost-Effectiveness Ratios: A Comparison of Five Methods
- Open Access
- 14 September 2024
- Published by Springer Nature in Asia Pacific Education Review
- Vol. 27 (2) , 825
Correction: Design and analysis of cluster randomized trials
- 14 September 2024
- Published by Springer Nature in Asia Pacific Education Review
- Vol. 27 (2) , 825
Open AccessCorrection: Design and analysis of cluster randomized trials
- 10 August 2024
- Published by Springer Nature in Asia Pacific Education Review
- Vol. 25 (3) , 685-701
Design and analysis of cluster randomized trials
- 10 August 2024
- Published by Springer Nature in Asia Pacific Education Review
- Vol. 25 (3) , 685-701
Design and analysis of cluster randomized trials
- 19 December 2022
- Published by Taylor & Francis in Journal of Research on Educational Effectiveness
- Vol. 16 (4) , 681-706
Experimental Design and Statistical Power for Cluster Randomized Cost-Effectiveness Trials
Cluster randomized trials (CRTs) are commonly used to evaluate educational interventions, particularly their effectiveness. Recently there has been greater emphasis on using these trials to explore cost-effectiveness. However, methods for establishing the power of cluster randomized cost-effectiveness trials (CRCETs) are limited. This study develops power computation formulas and statistical software to help researchers plan two- and three-level CRCETs. We illustrate the application of our formulas and software for the designs of CRCETs and discuss the influence of sample size, nesting effects, covariates, and the covariance between cost and effectiveness measures on the statistical power of cost-effectiveness estimates.
- 19 December 2022
- Published by Taylor & Francis in Journal of Research on Educational Effectiveness
- Vol. 16 (4) , 681-706
Experimental Design and Statistical Power for Cluster Randomized Cost-Effectiveness Trials
Cluster randomized trials (CRTs) are commonly used to evaluate educational interventions, particularly their effectiveness. Recently there has been greater emphasis on using these trials to explore cost-effectiveness. However, methods for establishing the power of cluster randomized cost-effectiveness trials (CRCETs) are limited. This study develops power computation formulas and statistical software to help researchers plan two- and three-level CRCETs. We illustrate the application of our formulas and software for the designs of CRCETs and discuss the influence of sample size, nesting effects, covariates, and the covariance between cost and effectiveness measures on the statistical power of cost-effectiveness estimates.
- 10 November 2021
- Published by Wiley in Journal of Research in Science Teaching
- Vol. 59 (3) , 423-457
The effect of a student–teacher–scientist partnership program on high school students' science achievement and attitudes about scientists
This article describes the effects of a student–teacher–scientist partnership program on high school students' science outcomes. The design was a cluster‐randomized trial with an analytic sample of 36 teachers randomly assigned to teach a photosynthesis‐ and respiration‐focused module including student‐designed investigations supported by online mentoring from scientists. Forty‐nine teachers were randomly assigned to teach photosynthesis and respiration to students as they normally would. The core finding was that implementing the module in combination with the online mentoring resulted in significant effects on student achievement (effect size = 0.284) and attitudes toward scientists (effect size = 0.280). The study sample was highly representative, demographically, to the US population of high schools. Future research should replicate the current study design, with the current and other related interventions, while examining component‐specific costs and efficacy. Related studies should also examine the relationship between the quality of scientist–student dialogue and student outcomes.
- 10 November 2021
- Published by Wiley in Journal of Research in Science Teaching
- Vol. 59 (3) , 423-457
The effect of a student–teacher–scientist partnership program on high school students' science achievement and attitudes about scientists
This article describes the effects of a student–teacher–scientist partnership program on high school students' science outcomes. The design was a cluster‐randomized trial with an analytic sample of 36 teachers randomly assigned to teach a photosynthesis‐ and respiration‐focused module including student‐designed investigations supported by online mentoring from scientists. Forty‐nine teachers were randomly assigned to teach photosynthesis and respiration to students as they normally would. The core finding was that implementing the module in combination with the online mentoring resulted in significant effects on student achievement (effect size = 0.284) and attitudes toward scientists (effect size = 0.280). The study sample was highly representative, demographically, to the US population of high schools. Future research should replicate the current study design, with the current and other related interventions, while examining component‐specific costs and efficacy. Related studies should also examine the relationship between the quality of scientist–student dialogue and student outcomes.
- 12 August 2021
- Published by Springer Nature in Prevention Science
- Vol. 23 (5) , 764-773
Study Registration for the Field of Prevention Science: Considering Options and Paths Forward
The practice of prospectively registering the details of intervention studies in a public database or registry is gaining momentum across disciplines as a strategy for increasing the transparency, credibility, and accessibility of study findings. In this article, we consider five registries that may be relevant for registration of intervention studies in the field of prevention science: ClinicalTrials.gov, the American Economic Association Registry of Randomized Controlled Trials (AEA RCT Registry), the Open Science Framework Preregistration (OSF Preregistration), the Registry for International Development Impact Evaluations (RIDIE), and the Registry of Efficacy and Effectiveness Studies (REES). We examine the five registries in terms of substantive focus, study designs, and contents of registry entries. We consider two paths forward for prospective registration of intervention studies in the field of prevention science: Path A: register all studies in ClinicalTrials.gov and Path B: allow individual researchers to select the registry with the “best fit.” Lastly, we consider how the field might begin to establish norms around registration.
- 12 August 2021
- Published by Springer Nature in Prevention Science
- Vol. 23 (5) , 764-773
Study Registration for the Field of Prevention Science: Considering Options and Paths Forward
The practice of prospectively registering the details of intervention studies in a public database or registry is gaining momentum across disciplines as a strategy for increasing the transparency, credibility, and accessibility of study findings. In this article, we consider five registries that may be relevant for registration of intervention studies in the field of prevention science: ClinicalTrials.gov, the American Economic Association Registry of Randomized Controlled Trials (AEA RCT Registry), the Open Science Framework Preregistration (OSF Preregistration), the Registry for International Development Impact Evaluations (RIDIE), and the Registry of Efficacy and Effectiveness Studies (REES). We examine the five registries in terms of substantive focus, study designs, and contents of registry entries. We consider two paths forward for prospective registration of intervention studies in the field of prevention science: Path A: register all studies in ClinicalTrials.gov and Path B: allow individual researchers to select the registry with the “best fit.” Lastly, we consider how the field might begin to establish norms around registration.
- Open Access
- 14 October 2020
- Published by American Educational Research Association (AERA) in Journal of Educational and Behavioral Statistics
- Vol. 46 (5) , 527-559
Design Considerations in Multisite Randomized Trials Probing Moderated Treatment Effects
Past research has demonstrated that treatment effects frequently vary across sites (e.g., schools) and that such variation can be explained by site-level or individual-level variables (e.g., school size or gender). The purpose of this study is to develop a statistical framework and tools for the effective and efficient design of multisite randomized trials (MRTs) probing moderated treatment effects. The framework considers three core facets of such designs: (a) Level 1 and Level 2 moderators, (b) random and nonrandomly varying slopes (coefficients) of the treatment variable and its interaction terms with the moderators, and (c) binary and continuous moderators. We validate the formulas for calculating statistical power and the minimum detectable effect size difference with simulations, probe its sensitivity to model assumptions, execute the formulas in accessible software, demonstrate an application, and provide suggestions in designing MRTs probing moderated treatment effects.
- 14 October 2020
- Published by American Educational Research Association (AERA) in Journal of Educational and Behavioral Statistics
- Vol. 46 (5) , 527-559
Open AccessDesign Considerations in Multisite Randomized Trials Probing Moderated Treatment Effects
Past research has demonstrated that treatment effects frequently vary across sites (e.g., schools) and that such variation can be explained by site-level or individual-level variables (e.g., school size or gender). The purpose of this study is to develop a statistical framework and tools for the effective and efficient design of multisite randomized trials (MRTs) probing moderated treatment effects. The framework considers three core facets of such designs: (a) Level 1 and Level 2 moderators, (b) random and nonrandomly varying slopes (coefficients) of the treatment variable and its interaction terms with the moderators, and (c) binary and continuous moderators. We validate the formulas for calculating statistical power and the minimum detectable effect size difference with simulations, probe its sensitivity to model assumptions, execute the formulas in accessible software, demonstrate an application, and provide suggestions in designing MRTs probing moderated treatment effects.