Benjamin Kelcey
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Research Subjects
Benjamin Kelcey has a total of 16 co-authors. Here are the top co-authors by number of shared publications:
Dung Pham
College of Agricultural & Environmental Sciences, University of Georgia
2 shared publications- Nianbo Dong
University of North Carolina at Chapel Hill
2 shared publications - Alyshia Brooks Bowden
University of Pennsylvania
1 shared publication Jessaca Spybrook
Western Michigan University
1 shared publication- Jessaca Spybrook
Western Michigan University, Kalamazoo, MI, USA
1 shared publication - Jing Li
Department of Educational Psychology, University of Georgia, Athens, 30602, Georgia, USA
1 shared publication
Latest Publications
- 1 January 2026
- Published by Psychometric Society
Cost-Efficient Sampling Strategies for Cluster-Randomized Trials Detecting Moderation and Main Effects
Moderation analyses can answer questions about where, for whom, and under what conditions intervention effects are most salient. Together with the main effect analyses, which assess whether interventions work, the results from the moderation and main effect analyses provide the evidence base for effective policy development. The literature has developed statistical power formulas for the main and moderation effects. However, literature has not offered a holistic framework that simultaneously considers both cost efficiency and statistical power for experimental studies investigating these effects. The present study develops a jointly optimal design framework for cluster-randomized trials (CRTs) investigating both moderation and main effects. Such a framework enables researchers to identify optimal sampling allocations by accounting for sampling costs and statistical power for both effects. The results show that the optimal sample allocations in CRTs are the same for the average treatment effect and the moderated treatment effect with cluster-level moderators. The proposed methods, including optimal sample allocation calculations and power analyses for both effects, have been implemented in the R package odr.
- 1 January 2026
- Published by Psychometric Society
Cost-Efficient Sampling Strategies for Cluster-Randomized Trials Detecting Moderation and Main Effects
Moderation analyses can answer questions about where, for whom, and under what conditions intervention effects are most salient. Together with the main effect analyses, which assess whether interventions work, the results from the moderation and main effect analyses provide the evidence base for effective policy development. The literature has developed statistical power formulas for the main and moderation effects. However, literature has not offered a holistic framework that simultaneously considers both cost efficiency and statistical power for experimental studies investigating these effects. The present study develops a jointly optimal design framework for cluster-randomized trials (CRTs) investigating both moderation and main effects. Such a framework enables researchers to identify optimal sampling allocations by accounting for sampling costs and statistical power for both effects. The results show that the optimal sample allocations in CRTs are the same for the average treatment effect and the moderated treatment effect with cluster-level moderators. The proposed methods, including optimal sample allocation calculations and power analyses for both effects, have been implemented in the R package odr.
- Open Access
- 19 September 2024
- Published by Taylor & Francis in Journal of Research on Educational Effectiveness
- Vol. 18 (4) , 951-979
Advantages of Monte Carlo Confidence Intervals for Incremental Cost-Effectiveness Ratios: A Comparison of Five Methods
- 19 September 2024
- Published by Taylor & Francis in Journal of Research on Educational Effectiveness
- Vol. 18 (4) , 951-979
Open AccessAdvantages of Monte Carlo Confidence Intervals for Incremental Cost-Effectiveness Ratios: A Comparison of Five Methods
- Open Access
- 16 April 2024
- Published by Taylor & Francis in The Journal of Experimental Education
- Vol. 95 (1) , 299-318
A Practical Guide to Power Analyses of Moderation Effects in Multisite Individual and Cluster Randomized Trials
- 16 April 2024
- Published by Taylor & Francis in The Journal of Experimental Education
- Vol. 95 (1) , 299-318
Open AccessA Practical Guide to Power Analyses of Moderation Effects in Multisite Individual and Cluster Randomized Trials
- Open Access
- 7 November 2019
- Published by SAGE Publications in Organizational Research Methods
- Vol. 24 (1) , 55-77
Croon’s Bias-Corrected Factor Score Path Analysis for Small- to Moderate-Sample Multilevel Structural Equation Models
Maximum likelihood estimation of multilevel structural equation model (MLSEM) parameters is a preferred approach to probe theories involving latent variables in multilevel settings. Although maximum likelihood has many desirable properties, a major limitation is that it often fails to converge and can incur significant bias when implemented in studies with a small to moderate multilevel sample (e.g., fewer than 100 organizations with 10 or less individuals/organization). To address similar limitations in single-level SEM, literature has developed Croon’s bias-corrected factor score path analysis estimator that converges more regularly than maximum likelihood and delivers less biased parameter estimates with small to moderate sample sizes. We derive extensions to this framework for MLSEMs and probe the degree to which the estimator retains these advantages with small to moderate multilevel samples. The estimator emerges as a useful alternative or complement to maximum likelihood because it often outperforms maximum likelihood in small to moderate multilevel samples in terms of convergence, bias, error variance, and power. The proposed estimator is implemented as a function in R using lavaan and is illustrated using a multilevel mediation example.
- 7 November 2019
- Published by SAGE Publications in Organizational Research Methods
- Vol. 24 (1) , 55-77
Open AccessCroon’s Bias-Corrected Factor Score Path Analysis for Small- to Moderate-Sample Multilevel Structural Equation Models
Maximum likelihood estimation of multilevel structural equation model (MLSEM) parameters is a preferred approach to probe theories involving latent variables in multilevel settings. Although maximum likelihood has many desirable properties, a major limitation is that it often fails to converge and can incur significant bias when implemented in studies with a small to moderate multilevel sample (e.g., fewer than 100 organizations with 10 or less individuals/organization). To address similar limitations in single-level SEM, literature has developed Croon’s bias-corrected factor score path analysis estimator that converges more regularly than maximum likelihood and delivers less biased parameter estimates with small to moderate sample sizes. We derive extensions to this framework for MLSEMs and probe the degree to which the estimator retains these advantages with small to moderate multilevel samples. The estimator emerges as a useful alternative or complement to maximum likelihood because it often outperforms maximum likelihood in small to moderate multilevel samples in terms of convergence, bias, error variance, and power. The proposed estimator is implemented as a function in R using lavaan and is illustrated using a multilevel mediation example.