Björn Holzhauer
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Research Subjects
Björn Holzhauer has a total of 204 co-authors. Here are the top co-authors by number of shared publications:
Stevo Julius
Division of Cardiovascular Medicine, University of Michigan, Ann Arbor, MI, USA
6 shared publicationsSverre E. Kjeldsen
A Department of Cardiology , Oslo University Hospital , Ullevål , Oslo , Norway
5 shared publicationsTsushung A. Hua
D Novartis Pharma , East Hanover , NJ , USA
5 shared publicationsDion Zappe
Novartis Pharma, East Hanover, NJ, USA
4 shared publicationsMichael A. Weber
Department of Cardiovascular Medicine, State University of New York, Downstate College of Medicine, NY, USA
4 shared publications- Alberto Zanchetti
Istituto Auxologico Italiano and Centro Interuniversitario Fisiologia Clinica e Ipertensione, Università degli Studi di Milano, Milano, Italy
3 shared publications
Latest Publications
- Open Access
- 26 December 2025
- Published by Elsevier in Osteoarthritis and Cartilage
- Vol. 34 (5) , 657-666
Why is there no treatment for osteoarthritis – Opportunity for AI based big data analytics to advance the field
- 26 December 2025
- Published by Elsevier in Osteoarthritis and Cartilage
- Vol. 34 (5) , 657-666
Open AccessWhy is there no treatment for osteoarthritis – Opportunity for AI based big data analytics to advance the field
- 8 August 2023
- Published by Wiley in Pharmaceutical Statistics
- Vol. 22 (6) , 1062-1075
“Super‐covariates”: Using predicted control group outcome as a covariate in randomized clinical trials
The power of randomized controlled clinical trials to demonstrate the efficacy of a drug compared with a control group depends not just on how efficacious the drug is, but also on the variation in patients' outcomes. Adjusting for prognostic covariates during trial analysis can reduce this variation. For this reason, the primary statistical analysis of a clinical trial is often based on regression models that besides terms for treatment and some further terms (e.g., stratification factors used in the randomization scheme of the trial) also includes a baseline (pre‐treatment) assessment of the primary outcome. We suggest to include a “super‐covariate”—that is, a patient‐specific prediction of the control group outcome—as a further covariate (but not as an offset). We train a prognostic model or ensembles of such models on the individual patient (or aggregate) data of other studies in similar patients, but not the new trial under analysis. This has the potential to use historical data to increase the power of clinical trials and avoids the concern of type I error inflation with Bayesian approaches, but in contrast to them has a greater benefit for larger sample sizes. It is important for prognostic models behind “super‐covariates” to generalize well across different patient populations in order to similarly reduce unexplained variability whether the trial(s) to develop the model are identical to the new trial or not. In an example in neovascular age‐related macular degeneration we saw efficiency gains from the use of a “super‐covariate”.
- 8 August 2023
- Published by Wiley in Pharmaceutical Statistics
- Vol. 22 (6) , 1062-1075
“Super‐covariates”: Using predicted control group outcome as a covariate in randomized clinical trials
The power of randomized controlled clinical trials to demonstrate the efficacy of a drug compared with a control group depends not just on how efficacious the drug is, but also on the variation in patients' outcomes. Adjusting for prognostic covariates during trial analysis can reduce this variation. For this reason, the primary statistical analysis of a clinical trial is often based on regression models that besides terms for treatment and some further terms (e.g., stratification factors used in the randomization scheme of the trial) also includes a baseline (pre‐treatment) assessment of the primary outcome. We suggest to include a “super‐covariate”—that is, a patient‐specific prediction of the control group outcome—as a further covariate (but not as an offset). We train a prognostic model or ensembles of such models on the individual patient (or aggregate) data of other studies in similar patients, but not the new trial under analysis. This has the potential to use historical data to increase the power of clinical trials and avoids the concern of type I error inflation with Bayesian approaches, but in contrast to them has a greater benefit for larger sample sizes. It is important for prognostic models behind “super‐covariates” to generalize well across different patient populations in order to similarly reduce unexplained variability whether the trial(s) to develop the model are identical to the new trial or not. In an example in neovascular age‐related macular degeneration we saw efficiency gains from the use of a “super‐covariate”.
- 3 April 2022
- Published by Wiley in Pharmaceutical Statistics
- Vol. 21 (5) , 1005-1021
Eliciting judgements about dependent quantities of interest: The SHeffield ELicitation Framework extension and copula methods illustrated using an asthma case study
Pharmaceutical companies regularly need to make decisions about drug development programs based on the limited knowledge from early stage clinical trials. In this situation, eliciting the judgements of experts is an attractive approach for synthesising evidence on the unknown quantities of interest. When calculating the probability of success for a drug development program, multiple quantities of interest—such as the effect of a drug on different endpoints—should not be treated as unrelated. We discuss two approaches for establishing a multivariate distribution for several related quantities within the SHeffield ELicitation Framework (SHELF). The first approach elicits experts' judgements about a quantity of interest conditional on knowledge about another one. For the second approach, we first elicit marginal distributions for each quantity of interest. Then, for each pair of quantities, we elicit the concordance probability that both lie on the same side of their respective elicited medians. This allows us to specify a copula to obtain the joint distribution of the quantities of interest. We show how these approaches were used in an elicitation workshop that was performed to assess the probability of success of the registrational program of an asthma drug. The judgements of the experts, which were obtained prior to completion of the pivotal studies, were well aligned with the final trial results.
- 3 April 2022
- Published by Wiley in Pharmaceutical Statistics
- Vol. 21 (5) , 1005-1021
Eliciting judgements about dependent quantities of interest: The SHeffield ELicitation Framework extension and copula methods illustrated using an asthma case study
Pharmaceutical companies regularly need to make decisions about drug development programs based on the limited knowledge from early stage clinical trials. In this situation, eliciting the judgements of experts is an attractive approach for synthesising evidence on the unknown quantities of interest. When calculating the probability of success for a drug development program, multiple quantities of interest—such as the effect of a drug on different endpoints—should not be treated as unrelated. We discuss two approaches for establishing a multivariate distribution for several related quantities within the SHeffield ELicitation Framework (SHELF). The first approach elicits experts' judgements about a quantity of interest conditional on knowledge about another one. For the second approach, we first elicit marginal distributions for each quantity of interest. Then, for each pair of quantities, we elicit the concordance probability that both lie on the same side of their respective elicited medians. This allows us to specify a copula to obtain the joint distribution of the quantities of interest. We show how these approaches were used in an elicitation workshop that was performed to assess the probability of success of the registrational program of an asthma drug. The judgements of the experts, which were obtained prior to completion of the pivotal studies, were well aligned with the final trial results.
- 14 December 2021
- Published by Wiley in Pharmaceutical Statistics
- Vol. 21 (2) , 439-459
Improving the assessment of the probability of success in late stage drug development
There are several steps to confirming the safety and efficacy of a new medicine. A sequence of trials, each with its own objectives, is usually required. Quantitative risk metrics can be useful for informing decisions about whether a medicine should transition from one stage of development to the next. To obtain an estimate of the probability of regulatory approval, pharmaceutical companies may start with industry‐wide success rates and then apply to these subjective adjustments to reflect program‐specific information. However, this approach lacks transparency and fails to make full use of data from previous clinical trials. We describe a quantitative Bayesian approach for calculating the probability of success (PoS) at the end of phase II which incorporates internal clinical data from one or more phase IIb studies, industry‐wide success rates, and expert opinion or external data if needed. Using an example, we illustrate how PoS can be calculated accounting for differences between the phase II data and future phase III trials, and discuss how the methods can be extended to accommodate accelerated drug development pathways.
- 14 December 2021
- Published by Wiley in Pharmaceutical Statistics
- Vol. 21 (2) , 439-459
Improving the assessment of the probability of success in late stage drug development
There are several steps to confirming the safety and efficacy of a new medicine. A sequence of trials, each with its own objectives, is usually required. Quantitative risk metrics can be useful for informing decisions about whether a medicine should transition from one stage of development to the next. To obtain an estimate of the probability of regulatory approval, pharmaceutical companies may start with industry‐wide success rates and then apply to these subjective adjustments to reflect program‐specific information. However, this approach lacks transparency and fails to make full use of data from previous clinical trials. We describe a quantitative Bayesian approach for calculating the probability of success (PoS) at the end of phase II which incorporates internal clinical data from one or more phase IIb studies, industry‐wide success rates, and expert opinion or external data if needed. Using an example, we illustrate how PoS can be calculated accounting for differences between the phase II data and future phase III trials, and discuss how the methods can be extended to accommodate accelerated drug development pathways.
- Open Access
Predicting drug approvals: The Novartis data science and artificial intelligence challenge
- Open Access
- 1 May 2021
- Published by Taylor & Francis in Pragmatic and Observational Research
- Vol. ume 12, 25-35
Maximizing Adherence and Gaining New Information For Your Chronic Obstructive Pulmonary Disease (MAGNIFY COPD): Study Protocol for the Pragmatic, Cluster Randomized Trial Evaluating the Impact of Dual Bronchodilator with Add-On Sensor and Electronic Monitoring on Clinical Outcomes
Background: Poor treatment adherence in COPD patients is associated with poor clinical outcomes and increased healthcare burden. Personalized approaches for adherence management, supported with technology-based interventions, may offer benefits to patients and providers but are currently unproven in terms of clinical outcomes as opposed to adherence outcomes. Methods: Maximizing Adherence and Gaining New Information For Your COPD (MAGNIFY COPD study), a pragmatic cluster randomized trial, aims to evaluate the impact of an adherence technology package (interventional package), comprising an adherence review, ongoing provision of a dual bronchodilator but with an add-on inhaler sensor device and a connected mobile application. This will compare time to treatment failure and other clinical outcomes in patients identified at high risk of exacerbations with historic poor treatment adherence as measured by prescription collection to mono/dual therapy over one year (1312 patients) versus usual care. Treatment failure is defined as the first occurrence of one of the following: (1) moderate/severe COPD exacerbation, (2) prescription of triple therapy (inhaled corticosteroid/long-acting β2-agonist/long-acting muscarinic antagonist [ICS/LABA/LAMA]), (3) prescription of additional chronic therapy for COPD, or (4) respiratory-related death. Adherence, moderate/severe exacerbations, respiratory-related healthcare resource utilization and costs, and intervention package acceptance rate will also be assessed. Eligible primary care practices (N=176) participating in the Optimum Patient Care Quality Improvement Program will be randomized (1:1) to either adherence support cluster arm (suitable patients already receiving or initiated Ultibro® Breezhaler® [indacaterol/glycopyrronium] will be offered interventional package) or the control cluster arm (suitable patients continue to receive usual clinical care). Patients will be identified and outcomes collected from anonymized electronic medical records within the Optimum Patient Care Research Database. On study completion, electronic medical record data will be re-extracted to analyze outcomes in both study groups. Registration Number: ISRCTN10567920. Conclusion: MAGNIFY will explore patient benefits of technology-based interventions for electronic adherence monitoring.
- 1 May 2021
- Published by Taylor & Francis in Pragmatic and Observational Research
- Vol. ume 12, 25-35
Open AccessMaximizing Adherence and Gaining New Information For Your Chronic Obstructive Pulmonary Disease (MAGNIFY COPD): Study Protocol for the Pragmatic, Cluster Randomized Trial Evaluating the Impact of Dual Bronchodilator with Add-On Sensor and Electronic Monitoring on Clinical Outcomes
Background: Poor treatment adherence in COPD patients is associated with poor clinical outcomes and increased healthcare burden. Personalized approaches for adherence management, supported with technology-based interventions, may offer benefits to patients and providers but are currently unproven in terms of clinical outcomes as opposed to adherence outcomes. Methods: Maximizing Adherence and Gaining New Information For Your COPD (MAGNIFY COPD study), a pragmatic cluster randomized trial, aims to evaluate the impact of an adherence technology package (interventional package), comprising an adherence review, ongoing provision of a dual bronchodilator but with an add-on inhaler sensor device and a connected mobile application. This will compare time to treatment failure and other clinical outcomes in patients identified at high risk of exacerbations with historic poor treatment adherence as measured by prescription collection to mono/dual therapy over one year (1312 patients) versus usual care. Treatment failure is defined as the first occurrence of one of the following: (1) moderate/severe COPD exacerbation, (2) prescription of triple therapy (inhaled corticosteroid/long-acting β2-agonist/long-acting muscarinic antagonist [ICS/LABA/LAMA]), (3) prescription of additional chronic therapy for COPD, or (4) respiratory-related death. Adherence, moderate/severe exacerbations, respiratory-related healthcare resource utilization and costs, and intervention package acceptance rate will also be assessed. Eligible primary care practices (N=176) participating in the Optimum Patient Care Quality Improvement Program will be randomized (1:1) to either adherence support cluster arm (suitable patients already receiving or initiated Ultibro® Breezhaler® [indacaterol/glycopyrronium] will be offered interventional package) or the control cluster arm (suitable patients continue to receive usual clinical care). Patients will be identified and outcomes collected from anonymized electronic medical records within the Optimum Patient Care Research Database. On study completion, electronic medical record data will be re-extracted to analyze outcomes in both study groups. Registration Number: ISRCTN10567920. Conclusion: MAGNIFY will explore patient benefits of technology-based interventions for electronic adherence monitoring.
- Open Access
- 1 March 2021
- Published by Taylor & Francis in International Journal of Chronic Obstructive Pulmonary Disease
- Vol. ume 16, 677-688
Predicting Hospitalization Due to COPD Exacerbations in Swedish Primary Care Patients Using Machine Learning – Based on the ARCTIC Study
Purpose: Chronic obstructive pulmonary disease (COPD) exacerbations can negatively impact disease severity, progression, mortality and lead to hospitalizations. We aimed to develop a model that predicts a patient’s risk of hospitalization due to severe exacerbations (defined as COPD-related hospitalizations) of COPD, using Swedish patient level data. Patients and Methods: Patient level data for 7823 Swedish patients with COPD was collected from electronic medical records (EMRs) and national registries covering healthcare contacts, diagnoses, prescriptions, lab tests, hospitalizations and socioeconomic factors between 2000 and 2013. Models were created using machine-learning methods to predict risk of imminent exacerbation causing patient hospitalization due to COPD within the next 10 days. Exacerbations occurring within this period were considered as one event. Model performance was assessed using the Area under the Precision-Recall Curve (AUPRC). To compare performance with previous similar studies, the Area Under Receiver Operating Curve (AUROC) was also reported. The model with the highest mean cross validation AUPRC was selected as the final model and was in a final step trained on the entire training dataset. Results: The most important factors for predicting severe exacerbations were exacerbations in the previous six months and in whole history, number of COPD-related healthcare contacts and comorbidity burden. Validation on test data yielded an AUROC of 0.86 and AUPRC of 0.08, which was high in comparison to previously published attempts to predict COPD exacerbation. Conclusion: Our work suggests that clinically available information on patient history collected via automated retrieval from EMRs and national registries or directly during patient consultation can form the basis for future clinical tools to predict risk of severe COPD exacerbations.
- 1 March 2021
- Published by Taylor & Francis in International Journal of Chronic Obstructive Pulmonary Disease
- Vol. ume 16, 677-688
Open AccessPredicting Hospitalization Due to COPD Exacerbations in Swedish Primary Care Patients Using Machine Learning – Based on the ARCTIC Study
Purpose: Chronic obstructive pulmonary disease (COPD) exacerbations can negatively impact disease severity, progression, mortality and lead to hospitalizations. We aimed to develop a model that predicts a patient’s risk of hospitalization due to severe exacerbations (defined as COPD-related hospitalizations) of COPD, using Swedish patient level data. Patients and Methods: Patient level data for 7823 Swedish patients with COPD was collected from electronic medical records (EMRs) and national registries covering healthcare contacts, diagnoses, prescriptions, lab tests, hospitalizations and socioeconomic factors between 2000 and 2013. Models were created using machine-learning methods to predict risk of imminent exacerbation causing patient hospitalization due to COPD within the next 10 days. Exacerbations occurring within this period were considered as one event. Model performance was assessed using the Area under the Precision-Recall Curve (AUPRC). To compare performance with previous similar studies, the Area Under Receiver Operating Curve (AUROC) was also reported. The model with the highest mean cross validation AUPRC was selected as the final model and was in a final step trained on the entire training dataset. Results: The most important factors for predicting severe exacerbations were exacerbations in the previous six months and in whole history, number of COPD-related healthcare contacts and comorbidity burden. Validation on test data yielded an AUROC of 0.86 and AUPRC of 0.08, which was high in comparison to previously published attempts to predict COPD exacerbation. Conclusion: Our work suggests that clinically available information on patient history collected via automated retrieval from EMRs and national registries or directly during patient consultation can form the basis for future clinical tools to predict risk of severe COPD exacerbations.
- 6 January 2021
- Published by Taylor & Francis in Blood Pressure
- Vol. 30 (2) , 82-89
Cardiovascular outcomes at recommended blood pressure targets in middle-aged and elderly patients with type 2 diabetes mellitus and hypertension
Available data of event-based clinical outcomes trials show that little evidence supports the guidelines recommendations to lower blood pressure (BP) to <130/80 mmHg in middle-aged and elderly peop...
- 6 January 2021
- Published by Taylor & Francis in Blood Pressure
- Vol. 30 (2) , 82-89
Cardiovascular outcomes at recommended blood pressure targets in middle-aged and elderly patients with type 2 diabetes mellitus and hypertension
Available data of event-based clinical outcomes trials show that little evidence supports the guidelines recommendations to lower blood pressure (BP) to <130/80 mmHg in middle-aged and elderly peop...
- Open Access
- 6 January 2021
- Published by Taylor & Francis in Blood Pressure
- Vol. 30 (2) , 90-97
Cardiovascular outcomes at recommended blood pressure targets in middle-aged and elderly patients with type 2 diabetes mellitus compared to all middle-aged and elderly hypertensive study patients with high cardiovascular risk
Event-based clinical outcome trials have shown limited evidence to support guidelines recommendations to lower blood pressure (BP) to n = 5250) were compared with the entire VALUE population with high CV risk (n = 15,245). After adjustments for baseline differences between groups, a reduction in the proportion of visits in which BP was reduced to <140/90 mmHg, but not to <130/80 mmHg, was accompanied by a progressive increase in the risk of CV morbidity and mortality as well as stroke, myocardial infarction and heart failure in both diabetes mellitus and in all high-risk patients. Target BP <130/80 mmHg reduced stroke risk in the main population but not in the diabetes mellitus patients. Patients with diabetes mellitus had higher event rates for the primary cardiac endpoint and all-cause mortality driven by a higher rate of heart failure. In the high-risk hypertensive patients of the VALUE trial achieving more frequently BP <140/90 mmHg, but not <130/80 mmHg, showed principally the same protective effect on overall and cause-specific cardiovascular outcomes in patients with diabetes mellitus and in the general high-risk hypertensive population.
- 6 January 2021
- Published by Taylor & Francis in Blood Pressure
- Vol. 30 (2) , 90-97
Open AccessCardiovascular outcomes at recommended blood pressure targets in middle-aged and elderly patients with type 2 diabetes mellitus compared to all middle-aged and elderly hypertensive study patients with high cardiovascular risk
Event-based clinical outcome trials have shown limited evidence to support guidelines recommendations to lower blood pressure (BP) to n = 5250) were compared with the entire VALUE population with high CV risk (n = 15,245). After adjustments for baseline differences between groups, a reduction in the proportion of visits in which BP was reduced to <140/90 mmHg, but not to <130/80 mmHg, was accompanied by a progressive increase in the risk of CV morbidity and mortality as well as stroke, myocardial infarction and heart failure in both diabetes mellitus and in all high-risk patients. Target BP <130/80 mmHg reduced stroke risk in the main population but not in the diabetes mellitus patients. Patients with diabetes mellitus had higher event rates for the primary cardiac endpoint and all-cause mortality driven by a higher rate of heart failure. In the high-risk hypertensive patients of the VALUE trial achieving more frequently BP <140/90 mmHg, but not <130/80 mmHg, showed principally the same protective effect on overall and cause-specific cardiovascular outcomes in patients with diabetes mellitus and in the general high-risk hypertensive population.
- 5 July 2019
- Published by Taylor & Francis in Statistics in Biopharmaceutical Research
- Vol. 12 (1) , 107-116
Methods for Using Aggregate Historical Control Data in Meta-Analyses of Clinical Trials With Time-to-Event Endpoints
This paper deals with comparing a test with a control therapy using meta-analyses of data from randomized controlled trials with a time-to-event endpoint. Such analyses can often benefit from prior information about the distribution of control group outcomes. One possible source of this information is the published aggregate data about control groups of historical trials from the medical literature. We review methods for making posterior inference about exponentially distributed event times more robust to prior-data conflicts by discounting the prior information based on the extent of observed prior-data conflict. We use simulations to compare analyses without prior information with the meta-analytic combined, meta-analytic predictive and robust meta-analytic predictive approaches, as well as Bayesian model averaging using shrinkage priors. Bayesian model averaging via shrinkage priors with well-chosen hyperpriors performed best in terms of credible interval coverage and mean squared error across scenarios. For the robust meta-analytic predictive approach, there was little benefit in increasing the weight of the informative mixture components beyond 0.2 to 0.5. This was the case even when little prior-data conflict was expected, except with very sparse data or substantial between-trial heterogeneity in control group hazard rates.
- 5 July 2019
- Published by Taylor & Francis in Statistics in Biopharmaceutical Research
- Vol. 12 (1) , 107-116
Methods for Using Aggregate Historical Control Data in Meta-Analyses of Clinical Trials With Time-to-Event Endpoints
This paper deals with comparing a test with a control therapy using meta-analyses of data from randomized controlled trials with a time-to-event endpoint. Such analyses can often benefit from prior information about the distribution of control group outcomes. One possible source of this information is the published aggregate data about control groups of historical trials from the medical literature. We review methods for making posterior inference about exponentially distributed event times more robust to prior-data conflicts by discounting the prior information based on the extent of observed prior-data conflict. We use simulations to compare analyses without prior information with the meta-analytic combined, meta-analytic predictive and robust meta-analytic predictive approaches, as well as Bayesian model averaging using shrinkage priors. Bayesian model averaging via shrinkage priors with well-chosen hyperpriors performed best in terms of credible interval coverage and mean squared error across scenarios. For the robust meta-analytic predictive approach, there was little benefit in increasing the weight of the informative mixture components beyond 0.2 to 0.5. This was the case even when little prior-data conflict was expected, except with very sparse data or substantial between-trial heterogeneity in control group hazard rates.