David C. Hoaglin
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Previous Organizations / Institutes
The organizations / institutes from the scholar's other articles in the past ten years
Research Subjects
David C. Hoaglin has a total of 47 co-authors. Here are the top co-authors by number of shared publications:
- Elena Kulinskaya
School of Computing Sciences University of East Anglia Norwich UK
9 shared publications - Bo Huang
Pfizer Inc
6 shared publications - Gaohong Dong
Stats Inc
6 shared publications - Ilyas Bakbergenuly
School of Computing Sciences University of East Anglia Norwich UK
6 shared publications Duolao Wang
Liverpool School of Tropical Medicine Liverpool UK
3 shared publications- Johan Verbeeck
Data Science Institute, Interuniversity Institute for Biostatistics and Statistical Bioinformatics (I-Biostat), University of Hasselt , Hasselt
3 shared publications
Latest Publications
- Open Access
- 28 June 2023
- Published by Wiley in Research Synthesis Methods
- Vol. 14 (5) , 671-688
Estimation of heterogeneity variance based on a generalized Q statistic in meta‐analysis of log‐odds‐ratio
For estimation of heterogeneity variance in meta‐analysis of log‐odds‐ratio, we derive new mean‐ and median‐unbiased point estimators and new interval estimators based on a generalized statistic, , in which the weights depend on only the studies' effective sample sizes. We compare them with familiar estimators based on the inverse‐variance‐weights version of , In an extensive simulation, we studied the bias (including median bias) of the point estimators and the coverage (including left and right coverage error) of the confidence intervals. Most estimators add to each cell of the table when one cell contains a zero count; we include a version that always adds . The results show that: two of the new point estimators and two of the familiar point estimators are almost unbiased when the total sample size and the probability in the Control arm () is 0.1, and when and is 0.2 or 0.5; for , all estimators have negative bias for small to medium sample sizes, but for larger sample sizes some of the new median‐unbiased estimators are almost median‐unbiased; choices of interval estimators depend on values of parameters, but one of the new estimators is reasonable when and another, when or ; and lack of balance between left and right coverage errors for small and/or implies that the available approximations for the distributions of and are accurate only for larger sample sizes.
- 28 June 2023
- Published by Wiley in Research Synthesis Methods
- Vol. 14 (5) , 671-688
Open AccessEstimation of heterogeneity variance based on a generalized Q statistic in meta‐analysis of log‐odds‐ratio
For estimation of heterogeneity variance in meta‐analysis of log‐odds‐ratio, we derive new mean‐ and median‐unbiased point estimators and new interval estimators based on a generalized statistic, , in which the weights depend on only the studies' effective sample sizes. We compare them with familiar estimators based on the inverse‐variance‐weights version of , In an extensive simulation, we studied the bias (including median bias) of the point estimators and the coverage (including left and right coverage error) of the confidence intervals. Most estimators add to each cell of the table when one cell contains a zero count; we include a version that always adds . The results show that: two of the new point estimators and two of the familiar point estimators are almost unbiased when the total sample size and the probability in the Control arm () is 0.1, and when and is 0.2 or 0.5; for , all estimators have negative bias for small to medium sample sizes, but for larger sample sizes some of the new median‐unbiased estimators are almost median‐unbiased; choices of interval estimators depend on values of parameters, but one of the new estimators is reasonable when and another, when or ; and lack of balance between left and right coverage errors for small and/or implies that the available approximations for the distributions of and are accurate only for larger sample sizes.
- Open Access
- 21 June 2023
- Published by Springer Nature in BMC Medical Research Methodology
- Vol. 23 (1) , 1-18
On the Q statistic with constant weights in meta-analysis of binary outcomes
Background: Cochran’s Q statistic is routinely used for testing heterogeneity in meta-analysis. Its expected value (under an incorrect null distribution) is part of several popular estimators of the between-study variance, $$\tau ^2$$ . Those applications generally do not account for use of the studies’ estimated variances in the inverse-variance weights that define Q (more explicitly, $$Q_{IV}$$ ). Importantly, those weights make approximating the distribution of $$Q_{IV}$$ rather complicated. Methods: As an alternative, we are investigating a Q statistic, $$Q_F$$ , whose constant weights use only the studies’ arm-level sample sizes. For log-odds-ratio (LOR), log-relative-risk (LRR), and risk difference (RD) as the measures of effect, we study, by simulation, approximations to distributions of $$Q_{IV}$$ and $$Q_F$$ , as the basis for tests of heterogeneity. Results: The results show that: for LOR and LRR, a two-moment gamma approximation to the distribution of $$Q_F$$ works well for small sample sizes, and an approximation based on an algorithm of Farebrother is recommended for larger sample sizes. For RD, the Farebrother approximation works very well, even for small sample sizes. For $$Q_{IV}$$ , the standard chi-square approximation provides levels that are much too low for LOR and LRR and too high for RD. The Kulinskaya et al. (Res Synth Methods 2:254–70, 2011) approximation for RD and the Kulinskaya and Dollinger (BMC Med Res Methodol 15:49, 2015) approximation for LOR work well for $$n \ge 100$$ but have some convergence issues for very small sample sizes combined with small probabilities. Conclusions: The performance of the standard $$\chi ^2$$ approximation is inadequate for all three binary effect measures. Instead, we recommend a test of heterogeneity based on $$Q_F$$ and provide practical guidelines for choosing an appropriate test at the .05 level for all three effect measures.- 21 June 2023
- Published by Springer Nature in BMC Medical Research Methodology
- Vol. 23 (1) , 1-18
Open AccessOn the Q statistic with constant weights in meta-analysis of binary outcomes
Background: Cochran’s Q statistic is routinely used for testing heterogeneity in meta-analysis. Its expected value (under an incorrect null distribution) is part of several popular estimators of the between-study variance, $$\tau ^2$$ . Those applications generally do not account for use of the studies’ estimated variances in the inverse-variance weights that define Q (more explicitly, $$Q_{IV}$$ ). Importantly, those weights make approximating the distribution of $$Q_{IV}$$ rather complicated. Methods: As an alternative, we are investigating a Q statistic, $$Q_F$$ , whose constant weights use only the studies’ arm-level sample sizes. For log-odds-ratio (LOR), log-relative-risk (LRR), and risk difference (RD) as the measures of effect, we study, by simulation, approximations to distributions of $$Q_{IV}$$ and $$Q_F$$ , as the basis for tests of heterogeneity. Results: The results show that: for LOR and LRR, a two-moment gamma approximation to the distribution of $$Q_F$$ works well for small sample sizes, and an approximation based on an algorithm of Farebrother is recommended for larger sample sizes. For RD, the Farebrother approximation works very well, even for small sample sizes. For $$Q_{IV}$$ , the standard chi-square approximation provides levels that are much too low for LOR and LRR and too high for RD. The Kulinskaya et al. (Res Synth Methods 2:254–70, 2011) approximation for RD and the Kulinskaya and Dollinger (BMC Med Res Methodol 15:49, 2015) approximation for LOR work well for $$n \ge 100$$ but have some convergence issues for very small sample sizes combined with small probabilities. Conclusions: The performance of the standard $$\chi ^2$$ approximation is inadequate for all three binary effect measures. Instead, we recommend a test of heterogeneity based on $$Q_F$$ and provide practical guidelines for choosing an appropriate test at the .05 level for all three effect measures. - 20 February 2023
- Published by Wiley in Pharmaceutical Statistics
- Vol. 22 (4) , 748-756
The stratified win statistics (win ratio, win odds, and net benefit)
The win odds and the net benefit are related directly to each other and indirectly, through ties, to the win ratio. These three win statistics test the same null hypothesis of equal win probabilities between two groups. They provide similarp‐values and powers, because the Z‐values of their statistical tests are approximately equal. Thus, they can complement one another to show the strength of a treatment effect. In this article, we show that the estimated variances of the win statistics are also directly related regardless of ties or indirectly related through ties. Since its introduction in 2018, the stratified win ratio has been applied in designs and analyses of clinical trials, including Phase III and Phase IV studies. This article generalizes the stratified method to the win odds and the net benefit. As a result, the relations of the three win statistics and the approximate equivalence of their statistical tests also hold for the stratified win statistics.
- 20 February 2023
- Published by Wiley in Pharmaceutical Statistics
- Vol. 22 (4) , 748-756
The stratified win statistics (win ratio, win odds, and net benefit)
The win odds and the net benefit are related directly to each other and indirectly, through ties, to the win ratio. These three win statistics test the same null hypothesis of equal win probabilities between two groups. They provide similarp‐values and powers, because the Z‐values of their statistical tests are approximately equal. Thus, they can complement one another to show the strength of a treatment effect. In this article, we show that the estimated variances of the win statistics are also directly related regardless of ties or indirectly related through ties. Since its introduction in 2018, the stratified win ratio has been applied in designs and analyses of clinical trials, including Phase III and Phase IV studies. This article generalizes the stratified method to the win odds and the net benefit. As a result, the relations of the three win statistics and the approximate equivalence of their statistical tests also hold for the stratified win statistics.
- 10 August 2022
- Published by Taylor & Francis in Journal of Biopharmaceutical Statistics
- Vol. 33 (2) , 140-150
The win odds: statistical inference and regression
Generalized pairwise comparisons and win statistics (i.e., win ratio, win odds and net benefit) are advantageous in analyzing and interpreting a composite of multiple outcomes in clinical trials. An important limitation of these statistics is their inability to adjust for covariates other than by stratified analysis. Because the win ratio does not account for ties, the win odds, a modification that includes ties, has attracted attention. We review and combine information on the win odds to articulate the statistical inferences for the win odds. We also show alternative variance estimators based on the exact permutation and bootstrap as well as statistical inference via the probabilistic index. Finally, we extend multiple-covariate regression probabilistic index models to the win odds with a univariate outcome. As an illustration we apply the regression models to the data in the CHARM trial.
- 10 August 2022
- Published by Taylor & Francis in Journal of Biopharmaceutical Statistics
- Vol. 33 (2) , 140-150
The win odds: statistical inference and regression
Generalized pairwise comparisons and win statistics (i.e., win ratio, win odds and net benefit) are advantageous in analyzing and interpreting a composite of multiple outcomes in clinical trials. An important limitation of these statistics is their inability to adjust for covariates other than by stratified analysis. Because the win ratio does not account for ties, the win odds, a modification that includes ties, has attracted attention. We review and combine information on the win odds to articulate the statistical inferences for the win odds. We also show alternative variance estimators based on the exact permutation and bootstrap as well as statistical inference via the probabilistic index. Finally, we extend multiple-covariate regression probabilistic index models to the win odds with a univariate outcome. As an illustration we apply the regression models to the data in the CHARM trial.
- Open AccessSimulations for estimation of heterogeneity variance $τ^2$ in constant and inverse variance weights meta-analysis of log-odds-ratiosA number of popular estimators of the between-study variance, $\tau^2$, are based on the Cochran's $Q$ statistic for testing heterogeneity in meta analysis. We introduce new point and interval estimators of $\tau^2$ for log-odds-ratio. These include new DerSimonian-Kacker-type moment estimators based on the first moment of $Q_F$, the $Q$ statistic with effective-sample-size weights, and novel median-unbiased estimators. We study, by simulation, bias and coverage of these new estimators of $\tau^2$ and, for comparative purposes, bias and coverage of a number of well-known estimators based on the $Q$ statistic with inverse-variance weights, $Q_{IV}$, such as the Mandel-Paule, DerSimonian-Laird, and restricted-maximum-likelihood estimators, and an estimator based on the Kulinskaya-Dollinger (2015) improved approximation to $Q_{IV}$.Open AccessSimulations for estimation of heterogeneity variance $τ^2$ in constant and inverse variance weights meta-analysis of log-odds-ratiosA number of popular estimators of the between-study variance, $\tau^2$, are based on the Cochran's $Q$ statistic for testing heterogeneity in meta analysis. We introduce new point and interval estimators of $\tau^2$ for log-odds-ratio. These include new DerSimonian-Kacker-type moment estimators based on the first moment of $Q_F$, the $Q$ statistic with effective-sample-size weights, and novel median-unbiased estimators. We study, by simulation, bias and coverage of these new estimators of $\tau^2$ and, for comparative purposes, bias and coverage of a number of well-known estimators based on the $Q$ statistic with inverse-variance weights, $Q_{IV}$, such as the Mandel-Paule, DerSimonian-Laird, and restricted-maximum-likelihood estimators, and an estimator based on the Kulinskaya-Dollinger (2015) improved approximation to $Q_{IV}$.
- 27 June 2022
- Published by Wiley in Pharmaceutical Statistics
- Vol. 22 (1) , 20-33
Win statistics (win ratio, win odds, and net benefit) can complement one another to show the strength of the treatment effect on time‐to‐event outcomes
Conventional analyses of a composite of multiple time‐to‐event outcomes use the time to the first event. However, the first event may not be the most important outcome. To address this limitation, generalized pairwise comparisons and win statistics (win ratio, win odds, and net benefit) have become popular and have been applied to clinical trial practice. However, win ratio, win odds, and net benefit have typically been used separately. In this article, we examine the use of these three win statistics jointly for time‐to‐event outcomes. First, we explain the relation of point estimates and variances among the three win statistics, and the relation between the net benefit and the Mann–Whitney U statistic. Then we explain that the three win statistics are based on the same win proportions, and they test the same null hypothesis of equal win probabilities in two groups. We show theoretically that the Z‐values of the corresponding statistical tests are approximately equal; therefore, the three win statistics provide very similarp‐values and statistical powers. Finally, using simulation studies and data from a clinical trial, we demonstrate that, when there is no (or little) censoring, the three win statistics can complement one another to show the strength of the treatment effect. However, when the amount of censoring is not small, and without adjustment for censoring, the win odds and the net benefit may have an advantage for interpreting the treatment effect; with adjustment (e.g., IPCW adjustment) for censoring, the three win statistics can complement one another to show the strength of the treatment effect. For calculations we use the R package WINS, available on the CRAN (Comprehensive R Archive Network).
- 27 June 2022
- Published by Wiley in Pharmaceutical Statistics
- Vol. 22 (1) , 20-33
Win statistics (win ratio, win odds, and net benefit) can complement one another to show the strength of the treatment effect on time‐to‐event outcomes
Conventional analyses of a composite of multiple time‐to‐event outcomes use the time to the first event. However, the first event may not be the most important outcome. To address this limitation, generalized pairwise comparisons and win statistics (win ratio, win odds, and net benefit) have become popular and have been applied to clinical trial practice. However, win ratio, win odds, and net benefit have typically been used separately. In this article, we examine the use of these three win statistics jointly for time‐to‐event outcomes. First, we explain the relation of point estimates and variances among the three win statistics, and the relation between the net benefit and the Mann–Whitney U statistic. Then we explain that the three win statistics are based on the same win proportions, and they test the same null hypothesis of equal win probabilities in two groups. We show theoretically that the Z‐values of the corresponding statistical tests are approximately equal; therefore, the three win statistics provide very similarp‐values and statistical powers. Finally, using simulation studies and data from a clinical trial, we demonstrate that, when there is no (or little) censoring, the three win statistics can complement one another to show the strength of the treatment effect. However, when the amount of censoring is not small, and without adjustment for censoring, the win odds and the net benefit may have an advantage for interpreting the treatment effect; with adjustment (e.g., IPCW adjustment) for censoring, the three win statistics can complement one another to show the strength of the treatment effect. For calculations we use the R package WINS, available on the CRAN (Comprehensive R Archive Network).
- Open Access
- 30 January 2022
- Published by Wiley in British Journal of Mathematical and Statistical Psychology
- Vol. 75 (3) , 444-465
On the Q statistic with constant weights for standardized mean difference
Cochran's Q statistic is routinely used for testing heterogeneity in meta‐analysis. Its expected value is also used in several popular estimators of the between‐study variance, . Those applications generally have not considered the implications of its use of estimated variances in the inverse‐variance weights. Importantly, those weights make approximating the distribution of Q (more explicitly, ) rather complicated. As an alternative, we investigate a new Q statistic, , whose constant weights use only the studies' effective sample sizes. For the standardized mean difference as the measure of effect, we study, by simulation, approximations to distributions of and , as the basis for tests of heterogeneity and for new point and interval estimators of . These include new DerSimonian–Kacker‐type moment estimators based on the first moment of , and novel median‐unbiased estimators. The results show that: an approximation based on an algorithm of Farebrother follows both the null and the alternative distributions of reasonably well, whereas the usual chi‐squared approximation for the null distribution of and the Biggerstaff–Jackson approximation to its alternative distribution are poor; in estimating , our moment estimator based on is almost unbiased, the Mandel – Paule estimator has some negative bias in some situations, and the DerSimonian–Laird and restricted maximum likelihood estimators have considerable negative bias; and all 95% interval estimators have coverage that is too high when , but otherwise the Q ‐profile interval performs very well.
- 30 January 2022
- Published by Wiley in British Journal of Mathematical and Statistical Psychology
- Vol. 75 (3) , 444-465
Open AccessOn the Q statistic with constant weights for standardized mean difference
Cochran's Q statistic is routinely used for testing heterogeneity in meta‐analysis. Its expected value is also used in several popular estimators of the between‐study variance, . Those applications generally have not considered the implications of its use of estimated variances in the inverse‐variance weights. Importantly, those weights make approximating the distribution of Q (more explicitly, ) rather complicated. As an alternative, we investigate a new Q statistic, , whose constant weights use only the studies' effective sample sizes. For the standardized mean difference as the measure of effect, we study, by simulation, approximations to distributions of and , as the basis for tests of heterogeneity and for new point and interval estimators of . These include new DerSimonian–Kacker‐type moment estimators based on the first moment of , and novel median‐unbiased estimators. The results show that: an approximation based on an algorithm of Farebrother follows both the null and the alternative distributions of reasonably well, whereas the usual chi‐squared approximation for the null distribution of and the Biggerstaff–Jackson approximation to its alternative distribution are poor; in estimating , our moment estimator based on is almost unbiased, the Mandel – Paule estimator has some negative bias in some situations, and the DerSimonian–Laird and restricted maximum likelihood estimators have considerable negative bias; and all 95% interval estimators have coverage that is too high when , but otherwise the Q ‐profile interval performs very well.
- 9 June 2021
- Published by Elsevier in Journal of Clinical Epidemiology
- Vol. 138, 230
Letter to the Editor on detecting and dealing with heterogeneity in meta-analyses by Cordero and Dans.
- 9 June 2021
- Published by Elsevier in Journal of Clinical Epidemiology
- Vol. 138, 230
Letter to the Editor on detecting and dealing with heterogeneity in meta-analyses by Cordero and Dans.
- Open Access
- 10 May 2021
- Published by Wiley in Research Synthesis Methods
- Vol. 12 (6) , 711-730
A Q statistic with constant weights for assessing heterogeneity in meta‐analysis
The conventional Q statistic, using estimated inverse‐variance (IV) weights, underlies a variety of problems in random‐effects meta‐analysis. In previous work on standardized mean difference and log‐odds‐ratio, we found superior performance with an estimator of the overall effect whose weights use only group‐level sample sizes. The Q statistic with those weights has the form proposed by DerSimonian and Kacker. The distribution of this Q and the Q with IV weights must generally be approximated. We investigate approximations for those distributions, as a basis for testing and estimating the between‐study variance (τ2). A simulation study, with mean difference as the effect measure, provides a framework for assessing accuracy of the approximations, level and power of the tests, and bias in estimating τ2. Two examples illustrate estimation of τ2 and the overall mean difference. Use of Q with sample‐size‐based weights and its exact distribution (available for mean difference and evaluated by Farebrother's algorithm) provides precise levels even for very small and unbalanced sample sizes. The corresponding estimator of τ2 is almost unbiased for 10 or more small studies. This performance compares favorably with the extremely liberal behavior of the standard tests of heterogeneity and the largely biased estimators based on inverse‐variance weights.
- 10 May 2021
- Published by Wiley in Research Synthesis Methods
- Vol. 12 (6) , 711-730
Open AccessA Q statistic with constant weights for assessing heterogeneity in meta‐analysis
The conventional Q statistic, using estimated inverse‐variance (IV) weights, underlies a variety of problems in random‐effects meta‐analysis. In previous work on standardized mean difference and log‐odds‐ratio, we found superior performance with an estimator of the overall effect whose weights use only group‐level sample sizes. The Q statistic with those weights has the form proposed by DerSimonian and Kacker. The distribution of this Q and the Q with IV weights must generally be approximated. We investigate approximations for those distributions, as a basis for testing and estimating the between‐study variance (τ2). A simulation study, with mean difference as the effect measure, provides a framework for assessing accuracy of the approximations, level and power of the tests, and bias in estimating τ2. Two examples illustrate estimation of τ2 and the overall mean difference. Use of Q with sample‐size‐based weights and its exact distribution (available for mean difference and evaluated by Farebrother's algorithm) provides precise levels even for very small and unbalanced sample sizes. The corresponding estimator of τ2 is almost unbiased for 10 or more small studies. This performance compares favorably with the extremely liberal behavior of the standard tests of heterogeneity and the largely biased estimators based on inverse‐variance weights.
- 28 November 2020
- Published by Wiley in Pharmaceutical Statistics
- Vol. 20 (3) , 440-450
Adjusting win statistics for dependent censoring
For composite outcomes whose components can be prioritized on clinical importance, the win ratio, the net benefit and the win odds apply that order in comparing patients pairwise to produce wins and subsequently win proportions. Because these three statistics are derived using the same win proportions and they test the same hypothesis of equal win probabilities in the two treatment groups, we refer to them as win statistics. These methods, particularly the win ratio and the net benefit, have received increasing attention in methodological research and in design and analysis of clinical trials. For time‐to‐event outcomes, however, censoring may introduce bias. Previous work has shown that inverse‐probability‐of‐censoring weighting (IPCW) can correct the win ratio for bias from independent censoring. The present article uses the IPCW approach to adjust win statistics for dependent censoring that can be predicted by baseline covariates and/or time‐dependent covariates (producing the CovIPCW‐adjusted win statistics). Theoretically and with examples and simulations, we show that the CovIPCW‐adjusted win statistics are unbiased estimators of treatment effect in the presence of dependent censoring.
- 28 November 2020
- Published by Wiley in Pharmaceutical Statistics
- Vol. 20 (3) , 440-450
Adjusting win statistics for dependent censoring
For composite outcomes whose components can be prioritized on clinical importance, the win ratio, the net benefit and the win odds apply that order in comparing patients pairwise to produce wins and subsequently win proportions. Because these three statistics are derived using the same win proportions and they test the same hypothesis of equal win probabilities in the two treatment groups, we refer to them as win statistics. These methods, particularly the win ratio and the net benefit, have received increasing attention in methodological research and in design and analysis of clinical trials. For time‐to‐event outcomes, however, censoring may introduce bias. Previous work has shown that inverse‐probability‐of‐censoring weighting (IPCW) can correct the win ratio for bias from independent censoring. The present article uses the IPCW approach to adjust win statistics for dependent censoring that can be predicted by baseline covariates and/or time‐dependent covariates (producing the CovIPCW‐adjusted win statistics). Theoretically and with examples and simulations, we show that the CovIPCW‐adjusted win statistics are unbiased estimators of treatment effect in the presence of dependent censoring.