Robert Wolff
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Previous Organizations / Institutes
The organizations / institutes from the scholar's other articles in the past ten years
Robert Wolff has a total of 114 co-authors. Here are the top co-authors by number of shared publications:
Jos Kleijnen
Kleijnen Systematic Reviews Ltd, York, UK
9 shared publicationsMarie Westwood
Kleijnen Systematic Reviews, York, United Kingdom (R.F.W., M.W.).
3 shared publications- Małgorzata Maria Bała
Department of Hygiene and Dietetics, Chair of Epidemiology and Preventive Medicine, Jagiellonian University Medical College, Kraków, Poland
3 shared publications - Penny Whiting
Population Health Sciences, Bristol Medical School, University of Bristol, Bristol, UK
3 shared publications - Shona Helen Lang
Kleijnen Systematic Reviews Ltd, York, UK
3 shared publications Craig Wakeford
Biogen, Cambridge, USA
2 shared publications
Latest Publications
- Open Access
- 24 September 2026
- Published by Springer Nature in Antimicrobial Resistance & Infection Control
- Vol. 15 (1) , 120
Surveillance of antibiotic-resistant bacteria integrating whole genome sequencing and epidemiological information – a global, systematic review, 2012–2023
Background: Epidemiologic surveillance is one pillar in the global efforts to stop the spread of antibiotic-resistant bacteria (ARB) and increasingly includes whole genome sequencing (WGS). However, no review systematically examined the characteristics of such surveillance systems until February 2025. We conducted a systematic review to identify and describe routine surveillance systems of ARB, that integrate WGS and epidemiological information. Methods: A protocol was developed and published on PROSPERO. We searched 8 databases and Google. Included articles needed to report on a national or subnational surveillance system and include epidemiological data as well as WGS of carbapenem-resistant or carbapenemase-producing Enterobacterales (CRE) or Acinetobacter spp., methicillin-resistant Staphylococcus aureus (MRSA) or vancomycin-resistant Enterococci (VRE). Surveillance system characteristics were analysed narratively. Results: From 13,142 searched articles, 41 were included. The publications were stratified by pathogen. The strata demonstrated similar WGS approaches with a predominance of short-read sequencing platforms. Typing methods mostly included multilocus sequence typing and single nucleotide polymorphism -based analyses for higher discrimination. Reported cluster thresholds showed a wide range of values within and between species. Across strata, there was often a low level of epidemiological data collection, such as exposure of cases, and integration in cluster analyses. WGS surveillance complemented with at least basic epidemiological data has been reported from all six WHO regions for CRE. However, fewer studies and no studies at all for MRSA and VRE were included from the African, Eastern Mediterranean and South-East Asian regions. The national coverage of surveillance ranged from 36% for MRSA to 56% for CRE. Conclusion: WGS-based surveillance on ARB is employed worldwide with predominant use of short-read technology and largely consistent typing methods. Substantial variation in genomic clustering thresholds underscores the need for internationally harmonized standards for data analysis. Insufficient epidemiological information or lacking integration in the analysis of WGS data may reduce the ability to infer transmission pathways and identify outbreaks. To fully exploit the potential of WGS-based surveillance systems in this context for public health and contain current and prevent future outbreaks, we thus call for a routine collection of detailed epidemiological data.
- 24 September 2026
- Published by Springer Nature in Antimicrobial Resistance & Infection Control
- Vol. 15 (1) , 120
Open AccessSurveillance of antibiotic-resistant bacteria integrating whole genome sequencing and epidemiological information – a global, systematic review, 2012–2023
Background: Epidemiologic surveillance is one pillar in the global efforts to stop the spread of antibiotic-resistant bacteria (ARB) and increasingly includes whole genome sequencing (WGS). However, no review systematically examined the characteristics of such surveillance systems until February 2025. We conducted a systematic review to identify and describe routine surveillance systems of ARB, that integrate WGS and epidemiological information. Methods: A protocol was developed and published on PROSPERO. We searched 8 databases and Google. Included articles needed to report on a national or subnational surveillance system and include epidemiological data as well as WGS of carbapenem-resistant or carbapenemase-producing Enterobacterales (CRE) or Acinetobacter spp., methicillin-resistant Staphylococcus aureus (MRSA) or vancomycin-resistant Enterococci (VRE). Surveillance system characteristics were analysed narratively. Results: From 13,142 searched articles, 41 were included. The publications were stratified by pathogen. The strata demonstrated similar WGS approaches with a predominance of short-read sequencing platforms. Typing methods mostly included multilocus sequence typing and single nucleotide polymorphism -based analyses for higher discrimination. Reported cluster thresholds showed a wide range of values within and between species. Across strata, there was often a low level of epidemiological data collection, such as exposure of cases, and integration in cluster analyses. WGS surveillance complemented with at least basic epidemiological data has been reported from all six WHO regions for CRE. However, fewer studies and no studies at all for MRSA and VRE were included from the African, Eastern Mediterranean and South-East Asian regions. The national coverage of surveillance ranged from 36% for MRSA to 56% for CRE. Conclusion: WGS-based surveillance on ARB is employed worldwide with predominant use of short-read technology and largely consistent typing methods. Substantial variation in genomic clustering thresholds underscores the need for internationally harmonized standards for data analysis. Insufficient epidemiological information or lacking integration in the analysis of WGS data may reduce the ability to infer transmission pathways and identify outbreaks. To fully exploit the potential of WGS-based surveillance systems in this context for public health and contain current and prevent future outbreaks, we thus call for a routine collection of detailed epidemiological data.
- Open Access
- 24 March 2023
- Published by Elsevier in Travel Medicine and Infectious Disease
- Vol. 52, 102561
Comment on: “New recommendation on yellow fever booster vaccination in Germany”
- 24 March 2023
- Published by Elsevier in Travel Medicine and Infectious Disease
- Vol. 52, 102561
Open AccessComment on: “New recommendation on yellow fever booster vaccination in Germany”
- Top Cited Papers
- 1 July 2022
- Published by American College of Physicians in Annals of Internal Medicine
- Vol. 175 (7) , 1010-1018
QUAPAS: An Adaptation of the QUADAS-2 Tool to Assess Prognostic Accuracy Studies
A critical step of systematic reviews is to assess the risk of bias and applicability of individual studies. This article describes the adaptation of the QUADAS-2 (Quality Assessment of Diagnostic ... Whereas diagnostic tests help detect the cause of signs and symptoms, prognostic tests assist in evaluating the probable course of the disease and future outcome. Studies to evaluate prognostic tes...
- 1 July 2022
- Published by American College of Physicians in Annals of Internal Medicine
- Vol. 175 (7) , 1010-1018
Top Cited PapersQUAPAS: An Adaptation of the QUADAS-2 Tool to Assess Prognostic Accuracy Studies
A critical step of systematic reviews is to assess the risk of bias and applicability of individual studies. This article describes the adaptation of the QUADAS-2 (Quality Assessment of Diagnostic ... Whereas diagnostic tests help detect the cause of signs and symptoms, prognostic tests assist in evaluating the probable course of the disease and future outcome. Studies to evaluate prognostic tes...
- Open Access
- 17 February 2022
- Published by Springer Nature in BMC Medical Informatics and Decision Making
- Vol. 22 (1) , 1-11
A scattered landscape: assessment of the evidence base for 71 patient decision aids developed in a hospital setting
Background: Recent publications reveal shortcomings in evidence review and summarization methods for patient decision aids. In the large-scale “Share to Care (S2C)” Shared Decision Making (SDM) project at the University Hospital Kiel, Germany, one of 4 SDM interventions was to develop up to 80 decision aids for patients. Best available evidence on the treatments’ impact on patient-relevant outcomes was systematically appraised to feed this information into the decision aids. Aims of this paper were to (1) describe how PtDAs are developed and how S2C evidence reviews for each PtDA are conducted, (2) appraise the quality of the best available evidence identified and (3) identify challenges associated with identified evidence. Methods: The quality of the identified evidence was assessed based on GRADE quality criteria and categorized into high-, moderate-, low-, very low-quality evidence. Evidence appraisal was conducted across all outcomes assessed in an evidence review and for specific groups of outcomes, namely mortality, morbidity, quality of life, and treatment harms. Challenges in evidence interpretation and summarization resulting from the characteristics of decision aids and the type and quality of evidence are identified and discussed. Results: Evidence reviews assessed on average 25 systematic reviews/guidelines/studies and took about 3 months to be completed. Despite rigorous review processes, nearly 70% of outcome-specific information derived for decision aids was based on low-quality and mostly on non-directly comparative evidence. Evidence on quality of life and harms was often not provided or not in sufficient form/detail. Challenges in evidence interpretation for use in decision aids resulted from, e.g., a lack of directly comparative evidence or the existence of very heterogeneous evidence for the diverse treatments being compared. Conclusions: Evidence reviews in this project were carefully conducted and summarized. However, the evidence identified for our decision aids was indeed a “scattered landscape” and often poor quality. Facing a high prevalence of low-quality, non-directly comparative evidence for treatment alternatives doesn’t mean it is not necessary to choose an evidence-based approach to inform patients. While there is an urgent need for high quality comparative trials, best available evidence nevertheless has to be appraised and transparently communicated to patients.
- 17 February 2022
- Published by Springer Nature in BMC Medical Informatics and Decision Making
- Vol. 22 (1) , 1-11
Open AccessA scattered landscape: assessment of the evidence base for 71 patient decision aids developed in a hospital setting
Background: Recent publications reveal shortcomings in evidence review and summarization methods for patient decision aids. In the large-scale “Share to Care (S2C)” Shared Decision Making (SDM) project at the University Hospital Kiel, Germany, one of 4 SDM interventions was to develop up to 80 decision aids for patients. Best available evidence on the treatments’ impact on patient-relevant outcomes was systematically appraised to feed this information into the decision aids. Aims of this paper were to (1) describe how PtDAs are developed and how S2C evidence reviews for each PtDA are conducted, (2) appraise the quality of the best available evidence identified and (3) identify challenges associated with identified evidence. Methods: The quality of the identified evidence was assessed based on GRADE quality criteria and categorized into high-, moderate-, low-, very low-quality evidence. Evidence appraisal was conducted across all outcomes assessed in an evidence review and for specific groups of outcomes, namely mortality, morbidity, quality of life, and treatment harms. Challenges in evidence interpretation and summarization resulting from the characteristics of decision aids and the type and quality of evidence are identified and discussed. Results: Evidence reviews assessed on average 25 systematic reviews/guidelines/studies and took about 3 months to be completed. Despite rigorous review processes, nearly 70% of outcome-specific information derived for decision aids was based on low-quality and mostly on non-directly comparative evidence. Evidence on quality of life and harms was often not provided or not in sufficient form/detail. Challenges in evidence interpretation for use in decision aids resulted from, e.g., a lack of directly comparative evidence or the existence of very heterogeneous evidence for the diverse treatments being compared. Conclusions: Evidence reviews in this project were carefully conducted and summarized. However, the evidence identified for our decision aids was indeed a “scattered landscape” and often poor quality. Facing a high prevalence of low-quality, non-directly comparative evidence for treatment alternatives doesn’t mean it is not necessary to choose an evidence-based approach to inform patients. While there is an urgent need for high quality comparative trials, best available evidence nevertheless has to be appraised and transparently communicated to patients.
- Open Access
Transcatheter aortic valve implantation versus surgical aortic valve replacement in patients with severe aortic stenosis: a systematic review and meta-analysis
Objectives: Patients undergoing surgery for severe aortic stenosis (SAS) can be treated with either transcatheter aortic valve implantation (TAVI) or surgical aortic valve replacement (SAVR). The choice of procedure depends on several factors, including the clinical judgement of the heart team and patient preferences, which are captured by actively informing and involving patients in a process of shared decision making (SDM). We synthesised the most up-to-date and accessible evidence on the benefits and risks that may be associated with TAVI versus SAVR to support SDM in this highly personalised decision-making process. Design: Systematic review and meta-analysis. Data sources: MEDLINE (Ovid), Embase (Ovid) and the Cochrane Central Register of Controlled Trials (CENTRAL; Wiley) were searched from January 2000 to August 2020 with no language restrictions. Reference lists of included studies were searched to identify additional studies. Eligibility criteria: Randomised controlled trials (RCTs) that compared TAVI versus SAVR in patients with SAS and reported on all-cause or cardiovascular mortality, length of stay in intensive care unit or hospital, valve durability, rehospitalisation/reintervention, stroke (any stroke or major/disabling stroke), myocardial infarction, major vascular complications, major bleeding, permanent pacemaker (PPM) implantation, new-onset or worsening atrial fibrillation (NOW-AF), endocarditis, acute kidney injury (AKI), recovery time or pain were included. Data extraction and synthesis: Two independent reviewers were involved in data extraction and risk of bias (ROB) assessment using the Cochrane tool (one reviewer extracted/assessed the data, and the second reviewer checked it). Dichotomous data were pooled using the Mantel-Haenszel method with random-effects to generate a risk ratio (RR) with 95% CI. Continuous data were pooled using the inverse-variance method with random-effects and expressed as a mean difference (MD) with 95% CI. Heterogeneity was assessed using the I 2 statistic. Results: 8969 records were retrieved and nine RCTs (61 records) were ultimately included (n=8818 participants). Two RCTs recruited high-risk patients, two RCTs recruited intermediate-risk patients, two RCTs recruited low-risk patients, one RCT recruited high-risk (≥70 years) or any-risk (≥80 years) patients; and two RCTs recruited all-risk or ‘operable’ patients. While there was no overall change in the risk of dying from any cause (30 day: RR 0.89, 95% CI 0.65 to 1.22; ≤1 year: RR 0.90, 95% CI 0.79 to 1.03; 5 years: RR 1.09, 95% CI 0.98 to 1.22), cardiovascular mortality (30 day: RR 1.03, 95% CI 0.77 to 1.39; ≤1 year: RR 0.90, 95% CI 0.76 to 1.06; 2 years: RR 0.96, 95% CI 0.83 to 1.12), or any type of stroke (30 day: RR 0.83, 95% CI 0.61 to 1.14;≤1 year: RR 0.94, 95% CI 0.72 to 1.23; 5 years: RR 1.07, 95% CI 0.88 to 1.30), the risk of several clinical outcomes was significantly decreased (major bleeding, AKI, NOW-AF) or significantly increased (major vascular complications, PPM implantation) for TAVI vs SAVR. TAVI was associated with a significantly shorter hospital stay vs SAVR (MD −3.08 days, 95% CI −4.86 to −1.29; 4 RCTs, n=2758 participants). Subgroup analysis generally favoured TAVI patients receiving implantation via the transfemoral (TF) route (vs non-TF); receiving a balloon-expandable (vs self-expanding) valve; and those at low-intermediate risk (vs high risk). All RCTs were rated at high ROB, predominantly due to lack of blinding and selective reporting. Conclusions: No overall change in the risk of death from any cause or cardiovascular mortality was identified but 95% CIs were often wide, indicating uncertainty. TAVI may reduce the risk of certain side effects while SAVR may reduce the risk of others. Most long-term (5-year) results are limited to older patients at high surgical risk (ie, early trials), therefore more data are required for low risk populations. Ultimately, neither surgical technique was considered dominant, and these results suggest that every patient with SAS should be individually engaged in SDM to make evidence-based, personalised decisions around their care based on the various benefits and risks associated with each treatment. PROSPERO registration number: CRD42019138171.
Open AccessTranscatheter aortic valve implantation versus surgical aortic valve replacement in patients with severe aortic stenosis: a systematic review and meta-analysis
Objectives: Patients undergoing surgery for severe aortic stenosis (SAS) can be treated with either transcatheter aortic valve implantation (TAVI) or surgical aortic valve replacement (SAVR). The choice of procedure depends on several factors, including the clinical judgement of the heart team and patient preferences, which are captured by actively informing and involving patients in a process of shared decision making (SDM). We synthesised the most up-to-date and accessible evidence on the benefits and risks that may be associated with TAVI versus SAVR to support SDM in this highly personalised decision-making process. Design: Systematic review and meta-analysis. Data sources: MEDLINE (Ovid), Embase (Ovid) and the Cochrane Central Register of Controlled Trials (CENTRAL; Wiley) were searched from January 2000 to August 2020 with no language restrictions. Reference lists of included studies were searched to identify additional studies. Eligibility criteria: Randomised controlled trials (RCTs) that compared TAVI versus SAVR in patients with SAS and reported on all-cause or cardiovascular mortality, length of stay in intensive care unit or hospital, valve durability, rehospitalisation/reintervention, stroke (any stroke or major/disabling stroke), myocardial infarction, major vascular complications, major bleeding, permanent pacemaker (PPM) implantation, new-onset or worsening atrial fibrillation (NOW-AF), endocarditis, acute kidney injury (AKI), recovery time or pain were included. Data extraction and synthesis: Two independent reviewers were involved in data extraction and risk of bias (ROB) assessment using the Cochrane tool (one reviewer extracted/assessed the data, and the second reviewer checked it). Dichotomous data were pooled using the Mantel-Haenszel method with random-effects to generate a risk ratio (RR) with 95% CI. Continuous data were pooled using the inverse-variance method with random-effects and expressed as a mean difference (MD) with 95% CI. Heterogeneity was assessed using the I 2 statistic. Results: 8969 records were retrieved and nine RCTs (61 records) were ultimately included (n=8818 participants). Two RCTs recruited high-risk patients, two RCTs recruited intermediate-risk patients, two RCTs recruited low-risk patients, one RCT recruited high-risk (≥70 years) or any-risk (≥80 years) patients; and two RCTs recruited all-risk or ‘operable’ patients. While there was no overall change in the risk of dying from any cause (30 day: RR 0.89, 95% CI 0.65 to 1.22; ≤1 year: RR 0.90, 95% CI 0.79 to 1.03; 5 years: RR 1.09, 95% CI 0.98 to 1.22), cardiovascular mortality (30 day: RR 1.03, 95% CI 0.77 to 1.39; ≤1 year: RR 0.90, 95% CI 0.76 to 1.06; 2 years: RR 0.96, 95% CI 0.83 to 1.12), or any type of stroke (30 day: RR 0.83, 95% CI 0.61 to 1.14;≤1 year: RR 0.94, 95% CI 0.72 to 1.23; 5 years: RR 1.07, 95% CI 0.88 to 1.30), the risk of several clinical outcomes was significantly decreased (major bleeding, AKI, NOW-AF) or significantly increased (major vascular complications, PPM implantation) for TAVI vs SAVR. TAVI was associated with a significantly shorter hospital stay vs SAVR (MD −3.08 days, 95% CI −4.86 to −1.29; 4 RCTs, n=2758 participants). Subgroup analysis generally favoured TAVI patients receiving implantation via the transfemoral (TF) route (vs non-TF); receiving a balloon-expandable (vs self-expanding) valve; and those at low-intermediate risk (vs high risk). All RCTs were rated at high ROB, predominantly due to lack of blinding and selective reporting. Conclusions: No overall change in the risk of death from any cause or cardiovascular mortality was identified but 95% CIs were often wide, indicating uncertainty. TAVI may reduce the risk of certain side effects while SAVR may reduce the risk of others. Most long-term (5-year) results are limited to older patients at high surgical risk (ie, early trials), therefore more data are required for low risk populations. Ultimately, neither surgical technique was considered dominant, and these results suggest that every patient with SAS should be individually engaged in SDM to make evidence-based, personalised decisions around their care based on the various benefits and risks associated with each treatment. PROSPERO registration number: CRD42019138171.
- Open Access
- 24 August 2021
- Published by MDPI AG in Journal of Clinical Medicine
- Vol. 10 (17) , 3761
Challenges and Controversies in the Surgical Treatment of Cervical Cancer: Open Radical Hysterectomy versus Minimally Invasive Radical Hysterectomy
Objective: The aim of the study was to perform a systematic assessment of disease-free survival (DFS), overall survival, and morbidity rates after open radical hysterectomy (ORH) and minimally invasive surgery (MIS) for early-stage cervical cancer and discuss with experts the consequences of the LACC trial (published by Ramirez et al. in 2018) on clinical routine. Methods: A total of 5428 records were retrieved. After exclusion based on text screening, four records were identified for inclusion. Five experts from three independent large-volume medical centers in Europe were interviewed for their interpretation of the LACC trial. Results: The LACC trial showed a significantly higher risk of disease progression with MIS compared to ORH (HR 3.74, 95% CI 1.63 to 8.58). This was not seen in one epidemiological study and was contradicted by one prospective cohort study reported by Greggi et al. A systematic review by Zhang et al. mentioned a similar DFS for robot-assisted radical hysterectomy (RRH) and LRH. Recurrence rates were significantly higher with MIS compared to ORH in the LACC trial (HR 4.26, 95% CI 1.44 to 12.60). In contrast, four studies presented by Greggi reported no significant difference in recurrence rates between LRH/RRH and ORH, which concurred with the systematic reviews of Zhang and Zhao. The experts mentioned various limitations of the LACC trial and stated that clinicians were obliged to provide patients with detailed information and ensure a shared decision-making process. Conclusions: The surgical treatment of early-stage cervical cancer remains a debated issue. More randomized controlled trials (RCT) will be needed to establish the most suitable treatment for this condition.
- 24 August 2021
- Published by MDPI AG in Journal of Clinical Medicine
- Vol. 10 (17) , 3761
Open AccessChallenges and Controversies in the Surgical Treatment of Cervical Cancer: Open Radical Hysterectomy versus Minimally Invasive Radical Hysterectomy
Objective: The aim of the study was to perform a systematic assessment of disease-free survival (DFS), overall survival, and morbidity rates after open radical hysterectomy (ORH) and minimally invasive surgery (MIS) for early-stage cervical cancer and discuss with experts the consequences of the LACC trial (published by Ramirez et al. in 2018) on clinical routine. Methods: A total of 5428 records were retrieved. After exclusion based on text screening, four records were identified for inclusion. Five experts from three independent large-volume medical centers in Europe were interviewed for their interpretation of the LACC trial. Results: The LACC trial showed a significantly higher risk of disease progression with MIS compared to ORH (HR 3.74, 95% CI 1.63 to 8.58). This was not seen in one epidemiological study and was contradicted by one prospective cohort study reported by Greggi et al. A systematic review by Zhang et al. mentioned a similar DFS for robot-assisted radical hysterectomy (RRH) and LRH. Recurrence rates were significantly higher with MIS compared to ORH in the LACC trial (HR 4.26, 95% CI 1.44 to 12.60). In contrast, four studies presented by Greggi reported no significant difference in recurrence rates between LRH/RRH and ORH, which concurred with the systematic reviews of Zhang and Zhao. The experts mentioned various limitations of the LACC trial and stated that clinicians were obliged to provide patients with detailed information and ensure a shared decision-making process. Conclusions: The surgical treatment of early-stage cervical cancer remains a debated issue. More randomized controlled trials (RCT) will be needed to establish the most suitable treatment for this condition.
- Open Access
- 28 September 2020
- Published by Springer Nature in Neurology and Therapy
- Vol. 9 (2) , 359-374
A Systematic Review and Mixed Treatment Comparison of Pharmaceutical Interventions for Multiple Sclerosis
Background Since 2010, 27 mixed-treatment comparisons (MTCs) of disease-modifying therapies (DMTs) for multiple sclerosis have been published. However, there has been continued evolution in the field of MTCs. Additionally, limitations in methodological approach and reporting transparency, even in the most recent publications, makes interpretation and comparison of existing studies difficult. Objectives The objectives of this study are twofold: (1) to estimate the efficacy and safety of DMTs at European Commission-approved doses compared with placebo in adults with relapsing–remitting multiple sclerosis (RRMS) using MTC, and (2) to identify and address methodological challenges when performing MTC in RRMS, thereby creating a baseline for comparisons with future treatments. Methods Searches were completed in 14 databases, including MEDLINE, Embase, CENTRAL, CDSR and DARE, from inception to June 2018 to identify published or unpublished prospective, randomised controlled trials of all European Union-approved DMTs or DMTs expected to be approved in the near future in RRMS or rapidly-evolving severe RRMS. No language or date restrictions were applied. Studies were included in the MTC if they were judged to have sufficiently similar characteristics, based on the following: patient age; proportion of male participants; Expanded Disability Status Scale (EDSS) score; duration of disease; number of relapses prior to enrolment and proportion of previously treated patients. Background information from the included studies, as well as effect size and confidence intervals (where relevant) of defined outcomes were extracted. Reporting of the MTC was consistent with the International Society for Pharmacoeconomics and Outcomes Research (ISPOR) and Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) network meta-analysis guidelines. Results In total, 33 studies were included in the MTC. Annualised relapse rate (ARR 28 trials) was significantly reduced in all treatments compared with placebo. Alemtuzumab had the highest probability (63%) of being the most effective treatment in terms of ARR compared with placebo (rate ratio [RR] 0.28, 95% credible interval [CrI] 0.21–0.38), followed by natalizumab (30% probability; RR 0.32, 95% CrI 0.23–0.43). The risk of 3- and 6-month confirmed disability progression (CDP3M, 13 trials; CDP6M, 14 trials) were similar; CDP6M was significantly reduced for alemtuzumab (hazard ratio [HR] 0.365; 95% CrI 0.165–0.725), ocrelizumab (HR 0.405, 95% CrI 0.188–0.853) and natalizumab (HR 0.459, 95% CrI 0.252–0.840) relative to placebo. There were no significant differences in the odds of serious adverse events (SAEs, 6 trials) between any treatment and placebo. The results of the MTC were limited by the lack of studies reporting direct comparisons between the included treatments and by heterogeneous reporting of key outcome data. Conclusions Meta-analyses confirmed the benefit of all DMTs in terms of relapse rate compared with placebo with a comparable rate of SAEs for the DMTs that could be included in the network. The rigor and transparency of reporting in this study provide a benchmark for comparisons with future new agents.
- 28 September 2020
- Published by Springer Nature in Neurology and Therapy
- Vol. 9 (2) , 359-374
Open AccessA Systematic Review and Mixed Treatment Comparison of Pharmaceutical Interventions for Multiple Sclerosis
Background Since 2010, 27 mixed-treatment comparisons (MTCs) of disease-modifying therapies (DMTs) for multiple sclerosis have been published. However, there has been continued evolution in the field of MTCs. Additionally, limitations in methodological approach and reporting transparency, even in the most recent publications, makes interpretation and comparison of existing studies difficult. Objectives The objectives of this study are twofold: (1) to estimate the efficacy and safety of DMTs at European Commission-approved doses compared with placebo in adults with relapsing–remitting multiple sclerosis (RRMS) using MTC, and (2) to identify and address methodological challenges when performing MTC in RRMS, thereby creating a baseline for comparisons with future treatments. Methods Searches were completed in 14 databases, including MEDLINE, Embase, CENTRAL, CDSR and DARE, from inception to June 2018 to identify published or unpublished prospective, randomised controlled trials of all European Union-approved DMTs or DMTs expected to be approved in the near future in RRMS or rapidly-evolving severe RRMS. No language or date restrictions were applied. Studies were included in the MTC if they were judged to have sufficiently similar characteristics, based on the following: patient age; proportion of male participants; Expanded Disability Status Scale (EDSS) score; duration of disease; number of relapses prior to enrolment and proportion of previously treated patients. Background information from the included studies, as well as effect size and confidence intervals (where relevant) of defined outcomes were extracted. Reporting of the MTC was consistent with the International Society for Pharmacoeconomics and Outcomes Research (ISPOR) and Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) network meta-analysis guidelines. Results In total, 33 studies were included in the MTC. Annualised relapse rate (ARR 28 trials) was significantly reduced in all treatments compared with placebo. Alemtuzumab had the highest probability (63%) of being the most effective treatment in terms of ARR compared with placebo (rate ratio [RR] 0.28, 95% credible interval [CrI] 0.21–0.38), followed by natalizumab (30% probability; RR 0.32, 95% CrI 0.23–0.43). The risk of 3- and 6-month confirmed disability progression (CDP3M, 13 trials; CDP6M, 14 trials) were similar; CDP6M was significantly reduced for alemtuzumab (hazard ratio [HR] 0.365; 95% CrI 0.165–0.725), ocrelizumab (HR 0.405, 95% CrI 0.188–0.853) and natalizumab (HR 0.459, 95% CrI 0.252–0.840) relative to placebo. There were no significant differences in the odds of serious adverse events (SAEs, 6 trials) between any treatment and placebo. The results of the MTC were limited by the lack of studies reporting direct comparisons between the included treatments and by heterogeneous reporting of key outcome data. Conclusions Meta-analyses confirmed the benefit of all DMTs in terms of relapse rate compared with placebo with a comparable rate of SAEs for the DMTs that could be included in the network. The rigor and transparency of reporting in this study provide a benchmark for comparisons with future new agents.
- Open Access
- 25 September 2020
- Published by Springer Nature in Neurology and Therapy
- Vol. 9 (2) , 335-358
Overview of Differences and Similarities of Published Mixed Treatment Comparisons on Pharmaceutical Interventions for Multiple Sclerosis
Introduction Mixed treatment comparisons (MTCs) are increasingly important in the assessment of the benefit–risk profile of pharmaceutical treatments for relapsing–remitting multiple sclerosis (RRMS). Interpretation of MTCs requires a clear understanding of the methods of analysis and population studied. The objectives of this work were to compare MTCs of pharmaceutical treatments for RRMS, including a detailed description of differences in populations, treatments assessed, methods used and findings; and to discuss key considerations when conducting an MTC. Methods Fourteen databases were searched until July 2019 to identify MTCs (published during or after 2010) in adults (at least 18 years of age) with RRMS or rapidly evolving severe RRMS treated with any form of pharmaceutical treatment. No language restriction was imposed. Results Twenty-seven MTCs assessing 21 treatments were identified. Comparison highlighted many differences in conduct and reporting between MTCs relating to the patient populations or treatments included, duration of follow-up and outcomes of interest measured. The lack of similarity between the MTCs leads to questions about variability in the robustness of analyses and makes comparisons between studies challenging. Conclusion Given the importance of MTCs for healthcare decision-making, it is imperative that reporting of methods, results and assumptions is clear and transparent to allow accurate interpretation of findings. For MTCs to be relevant, the choice of outcome measures should reflect clinical practice. Combination of treatments or of outcomes measured at different points of time should be avoided, as should imputation without justification. Furthermore, all approved treatment options should be included and updates of MTCs should be conducted when data for new treatments are published.
- 25 September 2020
- Published by Springer Nature in Neurology and Therapy
- Vol. 9 (2) , 335-358
Open AccessOverview of Differences and Similarities of Published Mixed Treatment Comparisons on Pharmaceutical Interventions for Multiple Sclerosis
Introduction Mixed treatment comparisons (MTCs) are increasingly important in the assessment of the benefit–risk profile of pharmaceutical treatments for relapsing–remitting multiple sclerosis (RRMS). Interpretation of MTCs requires a clear understanding of the methods of analysis and population studied. The objectives of this work were to compare MTCs of pharmaceutical treatments for RRMS, including a detailed description of differences in populations, treatments assessed, methods used and findings; and to discuss key considerations when conducting an MTC. Methods Fourteen databases were searched until July 2019 to identify MTCs (published during or after 2010) in adults (at least 18 years of age) with RRMS or rapidly evolving severe RRMS treated with any form of pharmaceutical treatment. No language restriction was imposed. Results Twenty-seven MTCs assessing 21 treatments were identified. Comparison highlighted many differences in conduct and reporting between MTCs relating to the patient populations or treatments included, duration of follow-up and outcomes of interest measured. The lack of similarity between the MTCs leads to questions about variability in the robustness of analyses and makes comparisons between studies challenging. Conclusion Given the importance of MTCs for healthcare decision-making, it is imperative that reporting of methods, results and assumptions is clear and transparent to allow accurate interpretation of findings. For MTCs to be relevant, the choice of outcome measures should reflect clinical practice. Combination of treatments or of outcomes measured at different points of time should be avoided, as should imputation without justification. Furthermore, all approved treatment options should be included and updates of MTCs should be conducted when data for new treatments are published.
- Top Cited PapersOpen Access
- 1 January 2019
- Published by American College of Physicians in Annals of Internal Medicine
- Vol. 170 (1) , 51-58
PROBAST: A Tool to Assess the Risk of Bias and Applicability of Prediction Model Studies
Clinical prediction models combine multiple predictors to estimate risk for the presence of a particular condition (diagnostic models) or the occurrence of a certain event in the future (prognostic models). PROBAST (Prediction model Risk Of Bias ASsessment Tool), a tool for assessing the risk of bias (ROB) and applicability of diagnostic and prognostic prediction model studies, was developed by a steering group that considered existing ROB tools and reporting guidelines. The tool was informed by a Delphi procedure involving 38 experts and was refined through piloting. PROBAST is organized into the following 4 domains: participants, predictors, outcome, and analysis. These domains contain a total of 20 signaling questions to facilitate structured judgment of ROB, which was defined to occur when shortcomings in study design, conduct, or analysis lead to systematically distorted estimates of model predictive performance. PROBAST enables a focused and transparent approach to assessing the ROB and applicability of studies that develop, validate, or update prediction models for individualized predictions. Although PROBAST was designed for systematic reviews, it can be used more generally in critical appraisal of prediction model studies. Potential users include organizations supporting decision making, researchers and clinicians who are interested in evidence-based medicine or involved in guideline development, journal editors, and manuscript reviewers.
- 1 January 2019
- Published by American College of Physicians in Annals of Internal Medicine
- Vol. 170 (1) , 51-58
Top Cited PapersOpen AccessPROBAST: A Tool to Assess the Risk of Bias and Applicability of Prediction Model Studies
Clinical prediction models combine multiple predictors to estimate risk for the presence of a particular condition (diagnostic models) or the occurrence of a certain event in the future (prognostic models). PROBAST (Prediction model Risk Of Bias ASsessment Tool), a tool for assessing the risk of bias (ROB) and applicability of diagnostic and prognostic prediction model studies, was developed by a steering group that considered existing ROB tools and reporting guidelines. The tool was informed by a Delphi procedure involving 38 experts and was refined through piloting. PROBAST is organized into the following 4 domains: participants, predictors, outcome, and analysis. These domains contain a total of 20 signaling questions to facilitate structured judgment of ROB, which was defined to occur when shortcomings in study design, conduct, or analysis lead to systematically distorted estimates of model predictive performance. PROBAST enables a focused and transparent approach to assessing the ROB and applicability of studies that develop, validate, or update prediction models for individualized predictions. Although PROBAST was designed for systematic reviews, it can be used more generally in critical appraisal of prediction model studies. Potential users include organizations supporting decision making, researchers and clinicians who are interested in evidence-based medicine or involved in guideline development, journal editors, and manuscript reviewers.
- Open Access
- 17 October 2017
- Published by Springer Nature in Systematic Reviews
- Vol. 6 (1) , 1-9
A proposed framework for developing quality assessment tools
Assessment of the quality of included studies is an essential component of any systematic review. A formal quality assessment is facilitated by using a structured tool. There are currently no guidelines available for researchers wanting to develop a new quality assessment tool. This paper provides a framework for developing quality assessment tools based on our experiences of developing a variety of quality assessment tools for studies of differing designs over the last 14 years. We have also drawn on experience from the work of the EQUATOR Network in producing guidance for developing reporting guidelines. We do not recommend a single ‘best’ approach. Instead, we provide a general framework with suggestions as to how the different stages can be approached. Our proposed framework is based around three key stages: initial steps, tool development and dissemination. We recommend that anyone who would like to develop a new quality assessment tool follow the stages outlined in this paper. We hope that our proposed framework will increase the number of tools developed using robust methods.
- 17 October 2017
- Published by Springer Nature in Systematic Reviews
- Vol. 6 (1) , 1-9
Open AccessA proposed framework for developing quality assessment tools
Assessment of the quality of included studies is an essential component of any systematic review. A formal quality assessment is facilitated by using a structured tool. There are currently no guidelines available for researchers wanting to develop a new quality assessment tool. This paper provides a framework for developing quality assessment tools based on our experiences of developing a variety of quality assessment tools for studies of differing designs over the last 14 years. We have also drawn on experience from the work of the EQUATOR Network in producing guidance for developing reporting guidelines. We do not recommend a single ‘best’ approach. Instead, we provide a general framework with suggestions as to how the different stages can be approached. Our proposed framework is based around three key stages: initial steps, tool development and dissemination. We recommend that anyone who would like to develop a new quality assessment tool follow the stages outlined in this paper. We hope that our proposed framework will increase the number of tools developed using robust methods.