Nathaniel Tyler Stevens
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Previous Organizations / Institutes
The organizations / institutes from the scholar's other articles in the past ten years
Nathaniel Tyler Stevens has a total of 68 co-authors. Here are the top co-authors by number of shared publications:
- James David Wilson
Department of Mathematics and Statistics, University of San Francisco, San Francisco, CA, USA
9 shared publications - Luke Hagar
Clinical Trials Capability, The University of Queensland
9 shared publications - Srijan Sengupta
Department of Statistics, North Carolina State University
5 shared publications Anne R. Driscoll
Virginia Polytechnic Institute and State University, Blacksburg, Virginia
4 shared publicationsCecile Paris
Computational Informatics, CSIRO, Sydney, New South Wales, Australia
4 shared publications- George Michailidis
Department of Statistics and Data Science University of California Los Angeles U.S.A
4 shared publications
Latest Publications
- 1 August 2026
- Published by Institute of Mathematical Statistics in Statistical Science
- Vol. 41 (3) , 507-523
Posterior Ramifications of Prior Dependence Structures
Prior elicitation methods for Bayesian analyses transfigure prior information into quantifiable prior distributions. Recently, methods that leverage copulas have been proposed to accommodate more flexible dependence structures when eliciting multivariate priors. We show that the posterior cannot retain many of these flexible prior dependence structures in large-sample settings, and we emphasize that it is our responsibility as statisticians to communicate this to practitioners. We therefore overview objectives for prior specification that guide conversations between statisticians and practitioners to promote alignment between the flexibility in the prior dependence structure and the objectives for posterior analysis. Because correctly specifying the dependence structure a priori can be difficult, we consider how the choice of prior copula impacts the posterior distribution in terms of asymptotic convergence of the posterior mode. Our resulting recommendations clarify when it is useful to elicit intricate prior dependence structures and when it is not.
- 1 August 2026
- Published by Institute of Mathematical Statistics in Statistical Science
- Vol. 41 (3) , 507-523
Posterior Ramifications of Prior Dependence Structures
Prior elicitation methods for Bayesian analyses transfigure prior information into quantifiable prior distributions. Recently, methods that leverage copulas have been proposed to accommodate more flexible dependence structures when eliciting multivariate priors. We show that the posterior cannot retain many of these flexible prior dependence structures in large-sample settings, and we emphasize that it is our responsibility as statisticians to communicate this to practitioners. We therefore overview objectives for prior specification that guide conversations between statisticians and practitioners to promote alignment between the flexibility in the prior dependence structure and the objectives for posterior analysis. Because correctly specifying the dependence structure a priori can be difficult, we consider how the choice of prior copula impacts the posterior distribution in terms of asymptotic convergence of the posterior mode. Our resulting recommendations clarify when it is useful to elicit intricate prior dependence structures and when it is not.
- Open Access
- 23 March 2026
- Published by Taylor & Francis in Journal of Business & Economic Statistics
- Vol. 44 (3) , 1-10
Design of Bayesian A/B Tests Controlling False Discovery Rates and Power
- 23 March 2026
- Published by Taylor & Francis in Journal of Business & Economic Statistics
- Vol. 44 (3) , 1-10
Open AccessDesign of Bayesian A/B Tests Controlling False Discovery Rates and Power
- 13 February 2026
- Published by Wiley in Statistics in Medicine
- Vol. 45 (3-5) , e70419
Risk‐Adjusted Surgical Learning Curve Assessment Using Comparative Probability Metrics
Surgical learning curves are graphical tools used to evaluate a trainee's progress in the early stages of their career and determine whether they have achieved proficiency after completing a specified number of surgeries. Cumulative sum (CUSUM)–based techniques are commonly used to assess learning curves due to their simplicity, but they face criticism for relying on fixed performance thresholds and lacking interpretability. This paper introduces a risk‐adjusted surgical learning curve assessment (SLCA) method that focuses on estimation rather than hypothesis testing (which is characteristic of CUSUM‐type methods). The proposed method is specifically designed to accommodate right‐skewed outcomes, such as surgery durations, which are well‐characterized by the Weibull distribution. To evaluate the learning process, the proposed SLCA approach sequentially estimates comparative probability metrics that assess the likelihood of a clinically important difference between the trainee's performance and a standard performance. Given the expectation that a trainee's performance will improve over time, we employ a weighted estimating equations approach to the estimation framework to assign greater weight to more recent outcomes compared to earlier ones. Compared to CUSUM‐based methods, the proposed methodology offers enhanced interpretability and deeper insights. It also avoids reliance on externally defined performance levels, which are often difficult to determine in practice, and it emphasizes assessing clinical equivalence or noninferiority rather than simply identifying a lack of difference. The effectiveness of the proposed method is demonstrated through a case study on a colorectal surgery dataset as well as a numerical study.
- 13 February 2026
- Published by Wiley in Statistics in Medicine
- Vol. 45 (3-5) , e70419
Risk‐Adjusted Surgical Learning Curve Assessment Using Comparative Probability Metrics
Surgical learning curves are graphical tools used to evaluate a trainee's progress in the early stages of their career and determine whether they have achieved proficiency after completing a specified number of surgeries. Cumulative sum (CUSUM)–based techniques are commonly used to assess learning curves due to their simplicity, but they face criticism for relying on fixed performance thresholds and lacking interpretability. This paper introduces a risk‐adjusted surgical learning curve assessment (SLCA) method that focuses on estimation rather than hypothesis testing (which is characteristic of CUSUM‐type methods). The proposed method is specifically designed to accommodate right‐skewed outcomes, such as surgery durations, which are well‐characterized by the Weibull distribution. To evaluate the learning process, the proposed SLCA approach sequentially estimates comparative probability metrics that assess the likelihood of a clinically important difference between the trainee's performance and a standard performance. Given the expectation that a trainee's performance will improve over time, we employ a weighted estimating equations approach to the estimation framework to assign greater weight to more recent outcomes compared to earlier ones. Compared to CUSUM‐based methods, the proposed methodology offers enhanced interpretability and deeper insights. It also avoids reliance on externally defined performance levels, which are often difficult to determine in practice, and it emphasizes assessing clinical equivalence or noninferiority rather than simply identifying a lack of difference. The effectiveness of the proposed method is demonstrated through a case study on a colorectal surgery dataset as well as a numerical study.
- 29 December 2025
- Published by Taylor & Francis in Technometrics
- Vol. 68 (2) , 399-412
Genetic Algorithm-Based Bayesian Optimal Design for Network Experiments
- 29 December 2025
- Published by Taylor & Francis in Technometrics
- Vol. 68 (2) , 399-412
Genetic Algorithm-Based Bayesian Optimal Design for Network Experiments
- Open Access
- 16 April 2025
- Published by Taylor & Francis in Journal of the American Statistical Association
- Vol. 120 (552) , 2559-2568
An Economical Approach to Design Posterior Analyses
- 16 April 2025
- Published by Taylor & Francis in Journal of the American Statistical Association
- Vol. 120 (552) , 2559-2568
Open AccessAn Economical Approach to Design Posterior Analyses
- Open Access
- 23 January 2025
- Published by Wiley in Statistics in Medicine
- Vol. 44 (3-4) , e10321
Bioequivalence Design With Sampling Distribution Segments
In bioequivalence design, power analyses dictate how much data must be collected to detect the absence of clinically important effects. Power is computed as a tail probability in the sampling distribution of the pertinent test statistics. When these test statistics cannot be constructed from pivotal quantities, their sampling distributions are approximated via repetitive, time‐intensive computer simulation. We propose a novel simulation‐based method to quickly approximate the power curve for many such bioequivalence tests by efficiently exploring segments (as opposed to the entirety) of the relevant sampling distributions. Despite not estimating the entire sampling distribution, this approach prompts unbiased sample size recommendations. We illustrate this method using two‐group bioequivalence tests with unequal variances and overview its broader applicability in clinical design. All methods proposed in this work can be implemented using the developed dent package in R.
- 23 January 2025
- Published by Wiley in Statistics in Medicine
- Vol. 44 (3-4) , e10321
Open AccessBioequivalence Design With Sampling Distribution Segments
In bioequivalence design, power analyses dictate how much data must be collected to detect the absence of clinically important effects. Power is computed as a tail probability in the sampling distribution of the pertinent test statistics. When these test statistics cannot be constructed from pivotal quantities, their sampling distributions are approximated via repetitive, time‐intensive computer simulation. We propose a novel simulation‐based method to quickly approximate the power curve for many such bioequivalence tests by efficiently exploring segments (as opposed to the entirety) of the relevant sampling distributions. Despite not estimating the entire sampling distribution, this approach prompts unbiased sample size recommendations. We illustrate this method using two‐group bioequivalence tests with unequal variances and overview its broader applicability in clinical design. All methods proposed in this work can be implemented using the developed dent package in R.
- Open Access
- 24 August 2024
- Published by Association for Computing Machinery (ACM)
- p. 4885-4895
Metric Decomposition in A/B Tests
More than a decade ago, CUPED (Controlled Experiments Utilizing Pre-Experiment Data) mainstreamed the idea of variance reduction leveraging pre-experiment covariates. Since its introduction, it has been implemented, extended, and modernized by major online experimentation platforms. Despite the wide adoption, it is known by practitioners that the variance reduction rate from CUPED utilizing pre-experimental data varies case by case and has a theoretical limit. In theory, CUPED can be extended to augment a treatment effect estimator utilizing in-experiment data, but practical guidance on how to construct such an augmentation is lacking. In this article, we fill this gap by proposing a new direction for sensitivity improvement via treatment effect augmentation whereby a target metric of interest is decomposed into components with high signal-to-noise disparity. Inference in the context of this decomposition is developed using both frequentist and Bayesian theory. We provide three real world applications demonstrating different flavors of metric decomposition; these applications illustrate the gain in agility metric decomposition yields relative to an un-decomposed analysis.
- 24 August 2024
- Published by Association for Computing Machinery (ACM)
- p. 4885-4895
Open AccessMetric Decomposition in A/B Tests
More than a decade ago, CUPED (Controlled Experiments Utilizing Pre-Experiment Data) mainstreamed the idea of variance reduction leveraging pre-experiment covariates. Since its introduction, it has been implemented, extended, and modernized by major online experimentation platforms. Despite the wide adoption, it is known by practitioners that the variance reduction rate from CUPED utilizing pre-experimental data varies case by case and has a theoretical limit. In theory, CUPED can be extended to augment a treatment effect estimator utilizing in-experiment data, but practical guidance on how to construct such an augmentation is lacking. In this article, we fill this gap by proposing a new direction for sensitivity improvement via treatment effect augmentation whereby a target metric of interest is decomposed into components with high signal-to-noise disparity. Inference in the context of this decomposition is developed using both frequentist and Bayesian theory. We provide three real world applications demonstrating different flavors of metric decomposition; these applications illustrate the gain in agility metric decomposition yields relative to an un-decomposed analysis.
- 16 January 2024
- Published by Taylor & Francis in Technometrics
- Vol. 66 (3) , 319-330
Assessing Measurement System Agreement in the Presence of Reproducibility and Repeatability
- 16 January 2024
- Published by Taylor & Francis in Technometrics
- Vol. 66 (3) , 319-330
Assessing Measurement System Agreement in the Presence of Reproducibility and Repeatability
- 2 January 2024
- Published by Taylor & Francis in Quality Engineering
- Vol. 36 (1) , 1-2
Editorial for reliability engineering special issue
- 2 January 2024
- Published by Taylor & Francis in Quality Engineering
- Vol. 36 (1) , 1-2
Editorial for reliability engineering special issue
- Open Access
From Augmentation to Decomposition: A New Look at CUPED in 2023
Ten years ago, CUPED (Controlled Experiments Utilizing Pre-Experiment Data) mainstreamed the idea of variance reduction leveraging pre-experiment covariates. Since its introduction, it has been implemented, extended, and modernized by major online experimentation platforms. Many researchers and practitioners often interpret CUPED as a regression adjustment. In this article, we clarify its similarities and differences to regression adjustment and present CUPED as a more general augmentation framework which is closer to the spirit of the 2013 paper. We show that the augmentation view naturally leads to cleaner developments of variance reduction beyond simple average metrics, including ratio metrics and percentile metrics. Moreover, the augmentation view can go beyond using pre-experiment data and leverage in-experiment data, leading to significantly larger variance reduction. We further introduce metric decomposition using approximate null augmentation (ANA) as a mental model for in-experiment variance reduction. We study it under both a Bayesian framework and a frequentist optimal proxy metric framework. Metric decomposition arises naturally in conversion funnels, so this work has broad applicability.
Open AccessFrom Augmentation to Decomposition: A New Look at CUPED in 2023
Ten years ago, CUPED (Controlled Experiments Utilizing Pre-Experiment Data) mainstreamed the idea of variance reduction leveraging pre-experiment covariates. Since its introduction, it has been implemented, extended, and modernized by major online experimentation platforms. Many researchers and practitioners often interpret CUPED as a regression adjustment. In this article, we clarify its similarities and differences to regression adjustment and present CUPED as a more general augmentation framework which is closer to the spirit of the 2013 paper. We show that the augmentation view naturally leads to cleaner developments of variance reduction beyond simple average metrics, including ratio metrics and percentile metrics. Moreover, the augmentation view can go beyond using pre-experiment data and leverage in-experiment data, leading to significantly larger variance reduction. We further introduce metric decomposition using approximate null augmentation (ANA) as a mental model for in-experiment variance reduction. We study it under both a Bayesian framework and a frequentist optimal proxy metric framework. Metric decomposition arises naturally in conversion funnels, so this work has broad applicability.