JLJohn Ludbrook

John Ludbrook

*This is an algorithmically generated author record based on publicly available information.

Current Organizations / Institutes

The organizations/institutes from the scholar's latest article

Previous Organizations / Institutes

The organizations / institutes from the scholar's other articles in the past ten years


John Ludbrook has a total of 2 co-authors. Here are the top co-authors by number of shared publications:

  • Alistair Royse

    Department of Surgery, The University of Melbourne, Melbourne, Vic, Australia; Department of Cardiothoracic Surgery, Royal Melbourne Hospital, Melbourne, Vic, Australia; Department of Medicine, RMIT University, Melbourne, Vic, Australia; Department of Surgery, Universiti Kebangsaan Malaysia, Kuala Lumpur, Malaysia

    1 shared publication
  • Michael J. Lew

    Department of Pharmacology, University of Melbourne, Parkville, Victoria, Australia

    1 shared publication

Latest Publications

  • Should we use one‐sided or two‐sided P values in tests of significance?

    by John Ludbrook

    Summary: ‘P’ stands for the probability, ranging in value from 0 to 1, that results from a test of significance. It can also be regarded as the strength of evidence against the statistical null hypothesis (H0). When H0 is evaluated by statistical tests based on distributions such as t, normal or Chi‐squared, P can be derived from one tail of the distribution (one‐sided or one‐tailed P), or it can be derived from both tails (two‐sided or two‐tailed P). Distinguished statisticians, the authors of statistical texts, the authors of guidelines for human and animal experimentation and the editors of biomedical journals give confusing advice, or none at all, about the choice between one‐ and two‐sided P values. Such a choice is available only when there are no more than two groups to be compared. I argue that the choice between one‐ and two‐sided P values depends on the alternative hypothesis (H1), which corresponds to the scientific hypothesis. If H1 is non‐specific and merely states that the means or proportions in the two groups are unequal, then a two‐sided P is appropriate. However, if H1 is specific and, for example, states than the mean or proportion of Group A is greater than that of Group B, then a one‐sided P maybe used. The form that H1 will take if H0 is rejected must be stipulated a priori, before the experiment is conducted. It is essential that authors state whether the P values resulting from their tests of significance are one‐ or two‐sided.


  • Analysing 2 × 2 contingency tables: Which test is best?

    by John Ludbrook

    A survey of five journals of physiology or pharmacology for 2011 showed that Fisher's exact test was used three times as frequently as Pearson's Chi-squared test. I shall argue that neither test is appropriate for analysing 2 × 2 tables of frequency in biomedical research. Pearson's test requires that random samples are taken from defined populations. The resultant 2 × 2 table is described as unconditional because neither the row nor column marginal totals are fixed in advance. Fisher's test requires the rare condition that both row and column marginal totals are fixed in advance. The resultant 2 × 2 table is described as doubly conditioned. However, the most common design of biomedical studies is that a sample of convenience is taken and divided randomly into two groups of predetermined size. The groups are then exposed to different sets of conditions. The binomial outcome is not fixed in advance, but depends on the result of the study. Thus, only the column (group) marginal totals are fixed in advance and the table is described as singly conditioned. Singly conditioned 2 × 2 tables are best analysed by tests of null hypotheses on the odds ratio (OR = 1) or by tests on proportions (p), such as the relative risk (RR = p2/p1 = 1) or the difference between proportions (p2 – p1 = 0). One enormous advantage of these procedures is that they test specific hypotheses. They should be executed in an exact fashion by permutation.


  • A primer for biomedical scientists on how to execute Model II linear regression analysis

    by John Ludbrook

    Summary: 1. There are two very different ways of executing linear regression analysis. One is Model I, when the x‐values are fixed by the experimenter. The other is Model II, in which the x‐values are free to vary and are subject to error.2. I have received numerous complaints from biomedical scientists that they have great difficulty in executing Model II linear regression analysis. This may explain the results of a Google Scholar search, which showed that the authors of articles in journals of physiology, pharmacology and biochemistry rarely use Model II regression analysis.3. I repeat my previous arguments in favour of using least products linear regression analysis for Model II regressions. I review three methods for executing ordinary least products (OLP) and weighted least products (WLP) regression analysis: (i) scientific calculator and/or computer spreadsheet; (ii) specific purpose computer programs; and (iii) general purpose computer programs.4. Using a scientific calculator and/or computer spreadsheet, it is easy to obtain correct values for OLP slope and intercept, but the corresponding 95% confidence intervals (CI) are inaccurate.5. Using specific purpose computer programs, the freeware computer program smatr gives the correct OLP regression coefficients and obtains 95% CI by bootstrapping. In addition, smatr can be used to compare the slopes of OLP lines.6. When using general purpose computer programs, I recommend the commercial programs systat and Statistica for those who regularly undertake linear regression analysis and I give step‐by‐step instructions in the Supplementary Information as to how to use loss functions.


  • Linear regression analysis for comparing two measurers or methods of measurement: But which regression?

    by John Ludbrook

    Summary: 1. There are two reasons for wanting to compare measurers or methods of measurement. One is to calibrate one method or measurer against another; the other is to detect bias. Fixed bias is present when one method gives higher (or lower) values across the whole range of measurement. Proportional bias is present when one method gives values that diverge progressively from those of the other.2. Linear regression analysis is a popular method for comparing methods of measurement, but the familiar ordinary least squares (OLS) method is rarely acceptable. The OLS method requires that the x values are fixed by the design of the study, whereas it is usual that both y and x values are free to vary and are subject to error. In this case, special regression techniques must be used.3. Clinical chemists favour techniques such as major axis regression (‘Deming’s method’), the Passing–Bablok method or the bivariate least median squares method. Other disciplines, such as allometry, astronomy, biology, econometrics, fisheries research, genetics, geology, physics and sports science, have their own preferences.4. Many Monte Carlo simulations have been performed to try to decide which technique is best, but the results are almost uninterpretable.5. I suggest that pharmacologists and physiologists should use ordinary least products regression analysis (geometric mean regression, reduced major axis regression): it is versatile, can be used for calibration or to detect bias and can be executed by hand‐held calculator or by using the loss function in popular, general‐purpose, statistical software.


  • Top Cited Papers

    Confidence in Altman–Bland plots: A critical review of the method of differences

    by John Ludbrook

    Summary: 1. Altman and Bland argue that the virtue of plotting differences against averages in method‐comparison studies is that 95% confidence limits for the differences can be constructed. These allow authors and readers to judge whether one method of measurement could be substituted for another.2. The technique is often misused. So I have set out, by statistical argument and worked examples, to advise pharmacologists and physiologists how best to construct these limits.3. First, construct a scattergram of differences on averages, then calculate the line of best fit for the linear regression of differences on averages. If the slope of the regression is shown to differ from zero, there is proportional bias.4. If there is no proportional bias and if the scatter of differences is uniform (homoscedasticity), construct ‘classical’ 95% confidence limits.5. If there is proportional bias yet homoscedasticity, construct hyperbolic 95% confidence limits (prediction interval) around the line of best fit.6. If there is proportional bias and the scatter of values for differences increases progressively as the average values increase (heteroscedasticity), log‐transform the raw values from the two methods and replot differences against averages. If this eliminates proportional bias and heteroscedasticity, construct ‘classical’ 95% confidence limits. Otherwise, construct horizontal V‐shaped 95% confidence limits around the line of best fit of differences on averages or around the weighted least products line of best fit to the original data.7. In designing a method‐comparison study, consult a qualified biostatistician, obey the rules of randomization and make replicate observations.


  • Estimating the risk of rare complications: is the ‘rule of three’ good enough?

    by John Ludbrook, Michael J. Lew

    The clinical problem:  If a surgeon has performed a particular operation on n consecutive patients without major complications, what is the long‐term risk of major complications after performing many more such operations? Examples of such operations are endoscopic cholecystectomy, nephrectomy and sympathectomy.The statistical problem and solutions:  This general problem has exercised the minds of theoretical statisticians for more than 80 years. They agree only that the long‐term risk is best expressed as the upper bound of a 95% confidence interval. We consider many proposed solutions, from those that involve complex statistical theory to the empirical ‘rule of three’, popular among clinicians, in which the percentage risk is given by the formula 100 × (3/n).Our conclusions:  The ‘rule of three’ grossly underestimates the future risks and can be applied only when the initial complication rate is zero (that is, 0/n). If the initial complication rate is greater than zero, then no simple ‘rule’ suffices. We give the results of applying the more popular statistical models, including their coverage. The ‘exact’ Clopper–Pearson interval has wider coverage across all proportions than its nominal 95%, and is, thus, too conservative. The Wilson score confidence interval gives about 95% coverage on average overall population proportions, except very small ones, so we prefer it to the Clopper–Pearson method. Unlike all the other intervals, Bayesian intervals with uniform priors yield exactly 95% coverage at any observed proportion. Thus, we strongly recommend Bayesian intervals and provide free software for executing them.


  • Open Access

    Analysis of 2 × 2 tables of frequencies: matching test to experimental design

    by John Ludbrook

    Background Biomedical investigators often use unsuitable statistical techniques for analysing the 2 × 2 tables that result from their experimental observations. This is because they are confused by the conflicting, and sometimes inaccurate, advice they receive from statistical texts or statistical consultants. Methods These consist of a review of published work, and the use of five different statistical procedures to analyse a 2 × 2 table, executed by StatXact 8.0, Testimate 6.0, Stata 10.0, SAS 9.1 and SPSS 16.0. Discussion and Conclusions It is essential to classify a 2 × 2 table before embarking on its analysis. A useful classification is into (i) Independence trials (doubly conditioned). These almost never occur in biomedical research because they involve predetermining the column and row totals in a 2 × 2 table. The Fisher exact test is the best method for analysing these trials. (ii) Comparative trials (singly conditioned). These correspond to the usual experimental design in biomedical work, in which a sample of convenience is randomized into two treatment groups, so that the group (column) totals are fixed in advance. The proper tests of significance are exact tests on the odds ratio, on the ratio of proportions (relative risk and risk ratio) or on the difference between proportions. (iii) Double dichotomy trials (unconditional). In these, a genuine random sample is taken from a defined population. Thus, neither column nor row totals are fixed in advance. The only practicable test is Pearson's χ2-test. In analysing any of the above trials, exact tests are to be much preferred to asymptotic (approximate) tests. The different commercial software packages use different algorithms for exact tests, and can give different outcomes in terms of P-values and confidence intervals. The most useful are StatXact and Testimate.


  • ANALYSING CLINICAL STUDIES: PRINCIPLES, PRACTICE AND PITFALLS OF KAPLAN–MEIER PLOTS

    by John Ludbrook, Alistair G. Royse

    The Probelm: The conventional method for estimating survival over time following an episode of disease or treatment is the Kaplan-Meier (K-M) technique, which results in a step-down survival plot, with upper and lower bounds of 1.0 and 0, respectively. The mirror image of this plot represents the cumulative incidence of an adverse event, such as death, with lower and upper bounds of 0 and 1.0, respectively. However, if there are two competing events that can occur during follow up, such as death or relapse, the K-M technique gives a false picture of the cumulative incidence of either one of these events. This occurs because patients who have died cannot subsequently relapse. The Solution: When there are two competing events, another technique must be used, which is known, variously, as cumulative incidence analysis, or 'actual' (as opposed to actuarial) incidence analysis. An example is given in which there are two competing adverse events following haemopoietic stem cell transplantation for a haematological malignancy: (i) relapse or (ii) transplant-related death. Our analysis of the example shows that the cumulative probability of relapse is progressively inflated if the traditional K-M product-limit method is used rather than actual cumulative incidence analysis. We show how K-M and actual cumulative survival or incidence analyses can be executed by a handheld calculator for small datasets or by formulae within a computer spreadsheet for large datasets. Conclusions: Surgical investigators should not use the K-M technique to predict cumulative survival or risk if there are two competing adverse events. They should use, instead, the technique of actual cumulative survival or incidence analysis.