NSNathaniel Tyler Stevens

Nathaniel Tyler Stevens

*This is an algorithmically generated author record based on publicly available information.

Current Organizations / Institutes

The organizations/institutes from the scholar's latest article

Previous Organizations / Institutes

The organizations / institutes from the scholar's other articles in the past ten years


Nathaniel Tyler Stevens has a total of 68 co-authors. Here are the top co-authors by number of shared publications:


Latest Publications

  • Posterior Ramifications of Prior Dependence Structures

    by Luke Hagar, Nathaniel T. Stevens

    Prior elicitation methods for Bayesian analyses transfigure prior information into quantifiable prior distributions. Recently, methods that leverage copulas have been proposed to accommodate more flexible dependence structures when eliciting multivariate priors. We show that the posterior cannot retain many of these flexible prior dependence structures in large-sample settings, and we emphasize that it is our responsibility as statisticians to communicate this to practitioners. We therefore overview objectives for prior specification that guide conversations between statisticians and practitioners to promote alignment between the flexibility in the prior dependence structure and the objectives for posterior analysis. Because correctly specifying the dependence structure a priori can be difficult, we consider how the choice of prior copula impacts the posterior distribution in terms of asymptotic convergence of the posterior mode. Our resulting recommendations clarify when it is useful to elicit intricate prior dependence structures and when it is not.

  • Risk‐Adjusted Surgical Learning Curve Assessment Using Comparative Probability Metrics

    by Adel Ahmadi Nadi, Stefan H. Steiner, Nathaniel T. Stevens

    Surgical learning curves are graphical tools used to evaluate a trainee's progress in the early stages of their career and determine whether they have achieved proficiency after completing a specified number of surgeries. Cumulative sum (CUSUM)–based techniques are commonly used to assess learning curves due to their simplicity, but they face criticism for relying on fixed performance thresholds and lacking interpretability. This paper introduces a risk‐adjusted surgical learning curve assessment (SLCA) method that focuses on estimation rather than hypothesis testing (which is characteristic of CUSUM‐type methods). The proposed method is specifically designed to accommodate right‐skewed outcomes, such as surgery durations, which are well‐characterized by the Weibull distribution. To evaluate the learning process, the proposed SLCA approach sequentially estimates comparative probability metrics that assess the likelihood of a clinically important difference between the trainee's performance and a standard performance. Given the expectation that a trainee's performance will improve over time, we employ a weighted estimating equations approach to the estimation framework to assign greater weight to more recent outcomes compared to earlier ones. Compared to CUSUM‐based methods, the proposed methodology offers enhanced interpretability and deeper insights. It also avoids reliance on externally defined performance levels, which are often difficult to determine in practice, and it emphasizes assessing clinical equivalence or noninferiority rather than simply identifying a lack of difference. The effectiveness of the proposed method is demonstrated through a case study on a colorectal surgery dataset as well as a numerical study.


  • Genetic Algorithm-Based Bayesian Optimal Design for Network Experiments

    by Trang Bui, Stefan H. Steiner, Nathaniel T. Stevens

  • Open Access

    Bioequivalence Design With Sampling Distribution Segments

    by Luke Hagar, Nathaniel T. Stevens

    In bioequivalence design, power analyses dictate how much data must be collected to detect the absence of clinically important effects. Power is computed as a tail probability in the sampling distribution of the pertinent test statistics. When these test statistics cannot be constructed from pivotal quantities, their sampling distributions are approximated via repetitive, time‐intensive computer simulation. We propose a novel simulation‐based method to quickly approximate the power curve for many such bioequivalence tests by efficiently exploring segments (as opposed to the entirety) of the relevant sampling distributions. Despite not estimating the entire sampling distribution, this approach prompts unbiased sample size recommendations. We illustrate this method using two‐group bioequivalence tests with unequal variances and overview its broader applicability in clinical design. All methods proposed in this work can be implemented using the developed dent package in R.


  • Open Access

    Metric Decomposition in A/B Tests

    by Alex Deng, Luke Hagar, Nathaniel T. Stevens, Tatiana Xifara, Amit Gandhi

    More than a decade ago, CUPED (Controlled Experiments Utilizing Pre-Experiment Data) mainstreamed the idea of variance reduction leveraging pre-experiment covariates. Since its introduction, it has been implemented, extended, and modernized by major online experimentation platforms. Despite the wide adoption, it is known by practitioners that the variance reduction rate from CUPED utilizing pre-experimental data varies case by case and has a theoretical limit. In theory, CUPED can be extended to augment a treatment effect estimator utilizing in-experiment data, but practical guidance on how to construct such an augmentation is lacking. In this article, we fill this gap by proposing a new direction for sensitivity improvement via treatment effect augmentation whereby a target metric of interest is decomposed into components with high signal-to-noise disparity. Inference in the context of this decomposition is developed using both frequentist and Bayesian theory. We provide three real world applications demonstrating different flavors of metric decomposition; these applications illustrate the gain in agility metric decomposition yields relative to an un-decomposed analysis.


  • Assessing Measurement System Agreement in the Presence of Reproducibility and Repeatability

    by Adel Ahmadi Nadi, Stefan H. Steiner, Nathaniel T. Stevens


  • Open Access

    From Augmentation to Decomposition: A New Look at CUPED in 2023

    by Alex Deng, Luke Hagar, Nathaniel Stevens, Tatiana Xifara, Lo-Hua Yuan, Amit Gandhi

    Ten years ago, CUPED (Controlled Experiments Utilizing Pre-Experiment Data) mainstreamed the idea of variance reduction leveraging pre-experiment covariates. Since its introduction, it has been implemented, extended, and modernized by major online experimentation platforms. Many researchers and practitioners often interpret CUPED as a regression adjustment. In this article, we clarify its similarities and differences to regression adjustment and present CUPED as a more general augmentation framework which is closer to the spirit of the 2013 paper. We show that the augmentation view naturally leads to cleaner developments of variance reduction beyond simple average metrics, including ratio metrics and percentile metrics. Moreover, the augmentation view can go beyond using pre-experiment data and leverage in-experiment data, leading to significantly larger variance reduction. We further introduce metric decomposition using approximate null augmentation (ANA) as a mental model for in-experiment variance reduction. We study it under both a Bayesian framework and a frequentist optimal proxy metric framework. Metric decomposition arises naturally in conversion funnels, so this work has broad applicability.