DHDavid C. Hoaglin

David C. Hoaglin

*This is an algorithmically generated author record based on publicly available information.

Current Organizations / Institutes

The organizations/institutes from the scholar's latest article

Previous Organizations / Institutes

The organizations / institutes from the scholar's other articles in the past ten years


David C. Hoaglin has a total of 47 co-authors. Here are the top co-authors by number of shared publications:


Latest Publications

  • Open Access

    Estimation of heterogeneity variance based on a generalized Q statistic in meta‐analysis of log‐odds‐ratio

    by Elena Kulinskaya, David C. Hoaglin

    For estimation of heterogeneity variance in meta‐analysis of log‐odds‐ratio, we derive new mean‐ and median‐unbiased point estimators and new interval estimators based on a generalized statistic, , in which the weights depend on only the studies' effective sample sizes. We compare them with familiar estimators based on the inverse‐variance‐weights version of , In an extensive simulation, we studied the bias (including median bias) of the point estimators and the coverage (including left and right coverage error) of the confidence intervals. Most estimators add to each cell of the table when one cell contains a zero count; we include a version that always adds . The results show that: two of the new point estimators and two of the familiar point estimators are almost unbiased when the total sample size and the probability in the Control arm () is 0.1, and when and is 0.2 or 0.5; for , all estimators have negative bias for small to medium sample sizes, but for larger sample sizes some of the new median‐unbiased estimators are almost median‐unbiased; choices of interval estimators depend on values of parameters, but one of the new estimators is reasonable when and another, when or ; and lack of balance between left and right coverage errors for small and/or implies that the available approximations for the distributions of and are accurate only for larger sample sizes.


  • Open Access

    On the Q statistic with constant weights in meta-analysis of binary outcomes

    by Elena Kulinskaya, David C. Hoaglin

    Background: Cochran’s Q statistic is routinely used for testing heterogeneity in meta-analysis. Its expected value (under an incorrect null distribution) is part of several popular estimators of the between-study variance, $$\tau ^2$$ τ 2 . Those applications generally do not account for use of the studies’ estimated variances in the inverse-variance weights that define Q (more explicitly, $$Q_{IV}$$ Q IV ). Importantly, those weights make approximating the distribution of $$Q_{IV}$$ Q IV rather complicated. Methods: As an alternative, we are investigating a Q statistic, $$Q_F$$ Q F , whose constant weights use only the studies’ arm-level sample sizes. For log-odds-ratio (LOR), log-relative-risk (LRR), and risk difference (RD) as the measures of effect, we study, by simulation, approximations to distributions of $$Q_{IV}$$ Q IV and $$Q_F$$ Q F , as the basis for tests of heterogeneity. Results: The results show that: for LOR and LRR, a two-moment gamma approximation to the distribution of $$Q_F$$ Q F works well for small sample sizes, and an approximation based on an algorithm of Farebrother is recommended for larger sample sizes. For RD, the Farebrother approximation works very well, even for small sample sizes. For $$Q_{IV}$$ Q IV , the standard chi-square approximation provides levels that are much too low for LOR and LRR and too high for RD. The Kulinskaya et al. (Res Synth Methods 2:254–70, 2011) approximation for RD and the Kulinskaya and Dollinger (BMC Med Res Methodol 15:49, 2015) approximation for LOR work well for $$n \ge 100$$ n ≥ 100 but have some convergence issues for very small sample sizes combined with small probabilities. Conclusions: The performance of the standard $$\chi ^2$$ χ 2 approximation is inadequate for all three binary effect measures. Instead, we recommend a test of heterogeneity based on $$Q_F$$ Q F and provide practical guidelines for choosing an appropriate test at the .05 level for all three effect measures.


  • The stratified win statistics (win ratio, win odds, and net benefit)

    by Gaohong Dong, David C. Hoaglin, Bo Huang, Ying Cui, Duolao Wang, Yu Cheng, Margaret Gamalo‐Siebers

    The win odds and the net benefit are related directly to each other and indirectly, through ties, to the win ratio. These three win statistics test the same null hypothesis of equal win probabilities between two groups. They provide similarp‐values and powers, because the Z‐values of their statistical tests are approximately equal. Thus, they can complement one another to show the strength of a treatment effect. In this article, we show that the estimated variances of the win statistics are also directly related regardless of ties or indirectly related through ties. Since its introduction in 2018, the stratified win ratio has been applied in designs and analyses of clinical trials, including Phase III and Phase IV studies. This article generalizes the stratified method to the win odds and the net benefit. As a result, the relations of the three win statistics and the approximate equivalence of their statistical tests also hold for the stratified win statistics.


  • The win odds: statistical inference and regression

    by James Song, Johan Verbeeck, Bo Huang, David C. Hoaglin, Margaret Gamalo-Siebers, Yodit Seifu, Duolao Wang, Freda Cooner, Gaohong Dong

    Generalized pairwise comparisons and win statistics (i.e., win ratio, win odds and net benefit) are advantageous in analyzing and interpreting a composite of multiple outcomes in clinical trials. An important limitation of these statistics is their inability to adjust for covariates other than by stratified analysis. Because the win ratio does not account for ties, the win odds, a modification that includes ties, has attracted attention. We review and combine information on the win odds to articulate the statistical inferences for the win odds. We also show alternative variance estimators based on the exact permutation and bootstrap as well as statistical inference via the probabilistic index. Finally, we extend multiple-covariate regression probabilistic index models to the win odds with a univariate outcome. As an illustration we apply the regression models to the data in the CHARM trial.


  • Open Access

    Simulations for estimation of heterogeneity variance $τ^2$ in constant and inverse variance weights meta-analysis of log-odds-ratios

    by Elena Kulinskaya, David C. Hoaglin

    A number of popular estimators of the between-study variance, $\tau^2$, are based on the Cochran's $Q$ statistic for testing heterogeneity in meta analysis. We introduce new point and interval estimators of $\tau^2$ for log-odds-ratio. These include new DerSimonian-Kacker-type moment estimators based on the first moment of $Q_F$, the $Q$ statistic with effective-sample-size weights, and novel median-unbiased estimators. We study, by simulation, bias and coverage of these new estimators of $\tau^2$ and, for comparative purposes, bias and coverage of a number of well-known estimators based on the $Q$ statistic with inverse-variance weights, $Q_{IV}$, such as the Mandel-Paule, DerSimonian-Laird, and restricted-maximum-likelihood estimators, and an estimator based on the Kulinskaya-Dollinger (2015) improved approximation to $Q_{IV}$.

  • Win statistics (win ratio, win odds, and net benefit) can complement one another to show the strength of the treatment effect on time‐to‐event outcomes

    by Gaohong Dong, Bo Huang, Johan Verbeeck, Ying Cui, James Song, Margaret Gamalo‐Siebers, Duolao Wang, David C. Hoaglin, Yodit Seifu, Tobias Mütze, et al.

    Conventional analyses of a composite of multiple time‐to‐event outcomes use the time to the first event. However, the first event may not be the most important outcome. To address this limitation, generalized pairwise comparisons and win statistics (win ratio, win odds, and net benefit) have become popular and have been applied to clinical trial practice. However, win ratio, win odds, and net benefit have typically been used separately. In this article, we examine the use of these three win statistics jointly for time‐to‐event outcomes. First, we explain the relation of point estimates and variances among the three win statistics, and the relation between the net benefit and the Mann–Whitney U statistic. Then we explain that the three win statistics are based on the same win proportions, and they test the same null hypothesis of equal win probabilities in two groups. We show theoretically that the Z‐values of the corresponding statistical tests are approximately equal; therefore, the three win statistics provide very similarp‐values and statistical powers. Finally, using simulation studies and data from a clinical trial, we demonstrate that, when there is no (or little) censoring, the three win statistics can complement one another to show the strength of the treatment effect. However, when the amount of censoring is not small, and without adjustment for censoring, the win odds and the net benefit may have an advantage for interpreting the treatment effect; with adjustment (e.g., IPCW adjustment) for censoring, the three win statistics can complement one another to show the strength of the treatment effect. For calculations we use the R package WINS, available on the CRAN (Comprehensive R Archive Network).


  • Open Access

    On the Q statistic with constant weights for standardized mean difference

    by Ilyas Bakbergenuly, David C. Hoaglin, Elena Kulinskaya

    Cochran's Q statistic is routinely used for testing heterogeneity in meta‐analysis. Its expected value is also used in several popular estimators of the between‐study variance, . Those applications generally have not considered the implications of its use of estimated variances in the inverse‐variance weights. Importantly, those weights make approximating the distribution of Q (more explicitly, ) rather complicated. As an alternative, we investigate a new Q statistic, , whose constant weights use only the studies' effective sample sizes. For the standardized mean difference as the measure of effect, we study, by simulation, approximations to distributions of and , as the basis for tests of heterogeneity and for new point and interval estimators of . These include new DerSimonian–Kacker‐type moment estimators based on the first moment of , and novel median‐unbiased estimators. The results show that: an approximation based on an algorithm of Farebrother follows both the null and the alternative distributions of reasonably well, whereas the usual chi‐squared approximation for the null distribution of and the Biggerstaff–Jackson approximation to its alternative distribution are poor; in estimating , our moment estimator based on is almost unbiased, the Mandel – Paule estimator has some negative bias in some situations, and the DerSimonian–Laird and restricted maximum likelihood estimators have considerable negative bias; and all 95% interval estimators have coverage that is too high when , but otherwise the Q ‐profile interval performs very well.


  • Open Access

    A Q statistic with constant weights for assessing heterogeneity in meta‐analysis

    by Elena Kulinskaya, David C. Hoaglin, Ilyas Bakbergenuly, Joseph Newman

    The conventional Q statistic, using estimated inverse‐variance (IV) weights, underlies a variety of problems in random‐effects meta‐analysis. In previous work on standardized mean difference and log‐odds‐ratio, we found superior performance with an estimator of the overall effect whose weights use only group‐level sample sizes. The Q statistic with those weights has the form proposed by DerSimonian and Kacker. The distribution of this Q and the Q with IV weights must generally be approximated. We investigate approximations for those distributions, as a basis for testing and estimating the between‐study variance (τ2). A simulation study, with mean difference as the effect measure, provides a framework for assessing accuracy of the approximations, level and power of the tests, and bias in estimating τ2. Two examples illustrate estimation of τ2 and the overall mean difference. Use of Q with sample‐size‐based weights and its exact distribution (available for mean difference and evaluated by Farebrother's algorithm) provides precise levels even for very small and unbalanced sample sizes. The corresponding estimator of τ2 is almost unbiased for 10 or more small studies. This performance compares favorably with the extremely liberal behavior of the standard tests of heterogeneity and the largely biased estimators based on inverse‐variance weights.


  • Adjusting win statistics for dependent censoring

    by Gaohong Dong, Bo Huang, Duolao Wang, Johan Verbeeck, Jiuzhou Wang, David C. Hoaglin

    For composite outcomes whose components can be prioritized on clinical importance, the win ratio, the net benefit and the win odds apply that order in comparing patients pairwise to produce wins and subsequently win proportions. Because these three statistics are derived using the same win proportions and they test the same hypothesis of equal win probabilities in the two treatment groups, we refer to them as win statistics. These methods, particularly the win ratio and the net benefit, have received increasing attention in methodological research and in design and analysis of clinical trials. For time‐to‐event outcomes, however, censoring may introduce bias. Previous work has shown that inverse‐probability‐of‐censoring weighting (IPCW) can correct the win ratio for bias from independent censoring. The present article uses the IPCW approach to adjust win statistics for dependent censoring that can be predicted by baseline covariates and/or time‐dependent covariates (producing the CovIPCW‐adjusted win statistics). Theoretically and with examples and simulations, we show that the CovIPCW‐adjusted win statistics are unbiased estimators of treatment effect in the presence of dependent censoring.