Bram L. T. Ramaekers
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Previous Organizations / Institutes
The organizations / institutes from the scholar's other articles in the past ten years
Research Subjects
Bram L. T. Ramaekers has a total of 406 co-authors. Here are the top co-authors by number of shared publications:
- Manuela A. Joore
Department of Clinical Epidemiology and Medical Technology Assessment, Maastricht University Medical Centre+ (MUMC+), Maastricht, The Netherlands
39 shared publications Nigel Armstrong
Kleijnen Systematic Reviews Ltd, York, UK
15 shared publicationsJos Kleijnen
Kleijnen Systematic Reviews Ltd, 6 Escrick Business Park, Riccall Road, York, YO19 6FD, UK
14 shared publications- Xavier Ghislain Léon Victor Pouwels
Section Health Technology and Services Research, Technical Medical Centre, Faculty of Behavioural, Management, and Social Sciences, University of Twente, Enschede, The Netherlands
12 shared publications - Janneke P. C. Grutters
Science Department IQ Health, Radboud University Medical Center, Nijmegen, The Netherlands
10 shared publications - Marie Westwood
Bristol Technology Assessment Group, Bristol Medical School, University of Bristol, Bristol, United Kingdom (P.F.W., E.T., M.E.W.)
6 shared publications
Latest Publications
- 9 October 2025
- Published by The R Foundation
PERSUADE: Parametric Survival Model Selection for Decision-Analytic Models
Provides a standardized framework to support the selection and evaluation of parametric survival models for time-to-event data. Includes tools for visualizing survival data, checking proportional hazards assumptions (Grambsch and Therneau, 1994, ), comparing parametric (Ishak and colleagues, 2013, ), spline (Royston and Parmar, 2002, ) and cure models, examining hazard functions, and evaluating model extrapolation. Methods are consistent with recommendations in the NICE Decision Support Unit Technical Support Documents (14 and 21 ). Results are structured to facilitate integration into decision-analytic models, and reports can be generated with 'rmarkdown'. The package builds on existing tools including 'flexsurv' (Jackson, 2016, )) and 'flexsurvcure' for estimating cure models.
- 9 October 2025
- Published by The R Foundation
PERSUADE: Parametric Survival Model Selection for Decision-Analytic Models
Provides a standardized framework to support the selection and evaluation of parametric survival models for time-to-event data. Includes tools for visualizing survival data, checking proportional hazards assumptions (Grambsch and Therneau, 1994, ), comparing parametric (Ishak and colleagues, 2013, ), spline (Royston and Parmar, 2002, ) and cure models, examining hazard functions, and evaluating model extrapolation. Methods are consistent with recommendations in the NICE Decision Support Unit Technical Support Documents (14 and 21 ). Results are structured to facilitate integration into decision-analytic models, and reports can be generated with 'rmarkdown'. The package builds on existing tools including 'flexsurv' (Jackson, 2016, )) and 'flexsurvcure' for estimating cure models.
- Open Access
- 9 July 2025
- Published by Springer Nature in Clinical Drug Investigation
- Vol. 45 (8) , 1-16
Cost-Effectiveness of Pembrolizumab Monotherapy for High Programmed Death Ligand 1 Advanced or Metastatic Non-small Cell Lung Cancer Depends on Long-Term Survivors
Background Pembrolizumab shows effectiveness in treating metastatic non-small cell lung cancer (metNSCLC), with a subgroup of patients experiencing long-term survival (LTS) benefits. The existence of a LTS subgroup may influence the cost-effectiveness of pembrolizumab monotherapy compared with platinum-based chemotherapy. This study aims to assess the potential implications of such a subgroup on the cost-effectiveness for patients with non-squamous metNSCLC and PD-L1 ≥ 50% who are ineligible for targeted therapies. Methods This study used a decision analytic model based on Dutch real-world data (2008–2014). Two strategies were simulated: (1) a chemotherapy strategy: patients receive chemotherapy in the first-, second-, and third-line; and (2) a pembrolizumab strategy: patients receive first-line pembrolizumab followed by chemotherapy for those progressing to second- and third-lines. The pembrolizumab strategy is evaluated with and without the assumption that there is a LTS subgroup. The LTS subgroup is assumed to be free from metNSCLC-related progression after treatment. Costs (2022 €), including drug costs, other direct medical costs, family costs, and healthcare costs in life years gained, are considered from first-line treatment to death. Effects are measured in quality-adjusted life years (QALYs). The incremental cost-effectiveness ratio (ICER) is assessed using an €80,000/QALY threshold. Threshold analyses are performed on the size and mortality rate of the LTS subgroup and on the price of pembrolizumab. Results QALYs per patient were 0.65 for chemotherapy, 1.24 for pembrolizumab without LTS, and 3.52 for pembrolizumab with LTS. Average costs per patient were €58,800 for chemotherapy, €154,600 for pembrolizumab without LTS, and €178,600 for pembrolizumab with LTS. Pembrolizumab without LTS was not cost-effective compared with chemotherapy (ICER €167,600/QALY), but pembrolizumab with LTS (30% of simulated population) was cost effective (ICER of €43,100/QALY). Threshold analyses showed that a LTS subgroup size of at least 10% or halving the price of pembrolizumab was needed for pembrolizumab to be cost-effective. Conclusions Pembrolizumab is a cost-effective first-line treatment for patients with metNSCLC and PD-L1 ≥ 50% in the Netherlands when at least 10% of patients are long-term survivors. Without long-term survivors, this treatment is not cost-effective. Therefore, it is crucial to consider long-term survivors in assessing the cost-effectiveness of immunotherapy in metNSCLC.
- 9 July 2025
- Published by Springer Nature in Clinical Drug Investigation
- Vol. 45 (8) , 1-16
Open AccessCost-Effectiveness of Pembrolizumab Monotherapy for High Programmed Death Ligand 1 Advanced or Metastatic Non-small Cell Lung Cancer Depends on Long-Term Survivors
Background Pembrolizumab shows effectiveness in treating metastatic non-small cell lung cancer (metNSCLC), with a subgroup of patients experiencing long-term survival (LTS) benefits. The existence of a LTS subgroup may influence the cost-effectiveness of pembrolizumab monotherapy compared with platinum-based chemotherapy. This study aims to assess the potential implications of such a subgroup on the cost-effectiveness for patients with non-squamous metNSCLC and PD-L1 ≥ 50% who are ineligible for targeted therapies. Methods This study used a decision analytic model based on Dutch real-world data (2008–2014). Two strategies were simulated: (1) a chemotherapy strategy: patients receive chemotherapy in the first-, second-, and third-line; and (2) a pembrolizumab strategy: patients receive first-line pembrolizumab followed by chemotherapy for those progressing to second- and third-lines. The pembrolizumab strategy is evaluated with and without the assumption that there is a LTS subgroup. The LTS subgroup is assumed to be free from metNSCLC-related progression after treatment. Costs (2022 €), including drug costs, other direct medical costs, family costs, and healthcare costs in life years gained, are considered from first-line treatment to death. Effects are measured in quality-adjusted life years (QALYs). The incremental cost-effectiveness ratio (ICER) is assessed using an €80,000/QALY threshold. Threshold analyses are performed on the size and mortality rate of the LTS subgroup and on the price of pembrolizumab. Results QALYs per patient were 0.65 for chemotherapy, 1.24 for pembrolizumab without LTS, and 3.52 for pembrolizumab with LTS. Average costs per patient were €58,800 for chemotherapy, €154,600 for pembrolizumab without LTS, and €178,600 for pembrolizumab with LTS. Pembrolizumab without LTS was not cost-effective compared with chemotherapy (ICER €167,600/QALY), but pembrolizumab with LTS (30% of simulated population) was cost effective (ICER of €43,100/QALY). Threshold analyses showed that a LTS subgroup size of at least 10% or halving the price of pembrolizumab was needed for pembrolizumab to be cost-effective. Conclusions Pembrolizumab is a cost-effective first-line treatment for patients with metNSCLC and PD-L1 ≥ 50% in the Netherlands when at least 10% of patients are long-term survivors. Without long-term survivors, this treatment is not cost-effective. Therefore, it is crucial to consider long-term survivors in assessing the cost-effectiveness of immunotherapy in metNSCLC.
- Open Access
- 1 March 2024
- Published by National Institute for Health and Care Research in Health Technology Assessment
- Vol. 28 (11) , 1-204
Software with artificial intelligence-derived algorithms for analysing CT brain scans in people with a suspected acute stroke: a systematic review and cost-effectiveness analysis
Background: Artificial intelligence-derived software technologies have been developed that are intended to facilitate the review of computed tomography brain scans in patients with suspected stroke. Objectives: To evaluate the clinical and cost-effectiveness of using artificial intelligence-derived software to support review of computed tomography brain scans in acute stroke in the National Health Service setting. Methods: Twenty-five databases were searched to July 2021. The review process included measures to minimise error and bias. Results were summarised by research question, artificial intelligence-derived software technology and study type. The health economic analysis focused on the addition of artificial intelligence-derived software-assisted review of computed tomography angiography brain scans for guiding mechanical thrombectomy treatment decisions for people with an ischaemic stroke. The de novo model (developed in R Shiny, R Foundation for Statistical Computing, Vienna, Austria) consisted of a decision tree (short-term) and a state transition model (long-term) to calculate the mean expected costs and quality-adjusted life-years for people with ischaemic stroke and suspected large-vessel occlusion comparing artificial intelligence-derived software-assisted review to usual care. Results: A total of 22 studies (30 publications) were included in the review; 18/22 studies concerned artificial intelligence-derived software for the interpretation of computed tomography angiography to detect large-vessel occlusion. No study evaluated an artificial intelligence-derived software technology used as specified in the inclusion criteria for this assessment. For artificial intelligence-derived software technology alone, sensitivity and specificity estimates for proximal anterior circulation large-vessel occlusion were 95.4% (95% confidence interval 92.7% to 97.1%) and 79.4% (95% confidence interval 75.8% to 82.6%) for Rapid (iSchemaView, Menlo Park, CA, USA) computed tomography angiography, 91.2% (95% confidence interval 77.0% to 97.0%) and 85.0 (95% confidence interval 64.0% to 94.8%) for Viz LVO (Viz.ai, Inc., San Fransisco, VA, USA) large-vessel occlusion, 83.8% (95% confidence interval 77.3% to 88.7%) and 95.7% (95% confidence interval 91.0% to 98.0%) for Brainomix (Brainomix Ltd, Oxford, UK) e-computed tomography angiography and 98.1% (95% confidence interval 94.5% to 99.3%) and 98.2% (95% confidence interval 95.5% to 99.3%) for Avicenna CINA (Avicenna AI, La Ciotat, France) large-vessel occlusion, based on one study each. These studies were not considered appropriate to inform cost-effectiveness modelling but formed the basis by which the accuracy of artificial intelligence plus human reader could be elicited by expert opinion. Probabilistic analyses based on the expert elicitation to inform the sensitivity of the diagnostic pathway indicated that the addition of artificial intelligence to detect large-vessel occlusion is potentially more effective (quality-adjusted life-year gain of 0.003), more costly (increased costs of £8.61) and cost-effective for willingness-to-pay thresholds of £3380 per quality-adjusted life-year and higher. Limitations and conclusions: The available evidence is not suitable to determine the clinical effectiveness of using artificial intelligence-derived software to support the review of computed tomography brain scans in acute stroke. The economic analyses did not provide evidence to prefer the artificial intelligence-derived software strategy over current clinical practice. However, results indicated that if the addition of artificial intelligence-derived software-assisted review for guiding mechanical thrombectomy treatment decisions increased the sensitivity of the diagnostic pathway (i.e. reduced the proportion of undetected large-vessel occlusions), this may be considered cost-effective. Future work: Large, preferably multicentre, studies are needed (for all artificial intelligence-derived software technologies) that evaluate these technologies as they would be implemented in clinical practice. Study registration: This study is registered as PROSPERO CRD42021269609. Funding: This award was funded by the National Institute for Health and Care Research (NIHR) Evidence Synthesis programme (NIHR award ref: NIHR133836) and is published in full in Health Technology Assessment; Vol. 28, No. 11. See the NIHR Funding and Awards website for further award information.
- 1 March 2024
- Published by National Institute for Health and Care Research in Health Technology Assessment
- Vol. 28 (11) , 1-204
Open AccessSoftware with artificial intelligence-derived algorithms for analysing CT brain scans in people with a suspected acute stroke: a systematic review and cost-effectiveness analysis
Background: Artificial intelligence-derived software technologies have been developed that are intended to facilitate the review of computed tomography brain scans in patients with suspected stroke. Objectives: To evaluate the clinical and cost-effectiveness of using artificial intelligence-derived software to support review of computed tomography brain scans in acute stroke in the National Health Service setting. Methods: Twenty-five databases were searched to July 2021. The review process included measures to minimise error and bias. Results were summarised by research question, artificial intelligence-derived software technology and study type. The health economic analysis focused on the addition of artificial intelligence-derived software-assisted review of computed tomography angiography brain scans for guiding mechanical thrombectomy treatment decisions for people with an ischaemic stroke. The de novo model (developed in R Shiny, R Foundation for Statistical Computing, Vienna, Austria) consisted of a decision tree (short-term) and a state transition model (long-term) to calculate the mean expected costs and quality-adjusted life-years for people with ischaemic stroke and suspected large-vessel occlusion comparing artificial intelligence-derived software-assisted review to usual care. Results: A total of 22 studies (30 publications) were included in the review; 18/22 studies concerned artificial intelligence-derived software for the interpretation of computed tomography angiography to detect large-vessel occlusion. No study evaluated an artificial intelligence-derived software technology used as specified in the inclusion criteria for this assessment. For artificial intelligence-derived software technology alone, sensitivity and specificity estimates for proximal anterior circulation large-vessel occlusion were 95.4% (95% confidence interval 92.7% to 97.1%) and 79.4% (95% confidence interval 75.8% to 82.6%) for Rapid (iSchemaView, Menlo Park, CA, USA) computed tomography angiography, 91.2% (95% confidence interval 77.0% to 97.0%) and 85.0 (95% confidence interval 64.0% to 94.8%) for Viz LVO (Viz.ai, Inc., San Fransisco, VA, USA) large-vessel occlusion, 83.8% (95% confidence interval 77.3% to 88.7%) and 95.7% (95% confidence interval 91.0% to 98.0%) for Brainomix (Brainomix Ltd, Oxford, UK) e-computed tomography angiography and 98.1% (95% confidence interval 94.5% to 99.3%) and 98.2% (95% confidence interval 95.5% to 99.3%) for Avicenna CINA (Avicenna AI, La Ciotat, France) large-vessel occlusion, based on one study each. These studies were not considered appropriate to inform cost-effectiveness modelling but formed the basis by which the accuracy of artificial intelligence plus human reader could be elicited by expert opinion. Probabilistic analyses based on the expert elicitation to inform the sensitivity of the diagnostic pathway indicated that the addition of artificial intelligence to detect large-vessel occlusion is potentially more effective (quality-adjusted life-year gain of 0.003), more costly (increased costs of £8.61) and cost-effective for willingness-to-pay thresholds of £3380 per quality-adjusted life-year and higher. Limitations and conclusions: The available evidence is not suitable to determine the clinical effectiveness of using artificial intelligence-derived software to support the review of computed tomography brain scans in acute stroke. The economic analyses did not provide evidence to prefer the artificial intelligence-derived software strategy over current clinical practice. However, results indicated that if the addition of artificial intelligence-derived software-assisted review for guiding mechanical thrombectomy treatment decisions increased the sensitivity of the diagnostic pathway (i.e. reduced the proportion of undetected large-vessel occlusions), this may be considered cost-effective. Future work: Large, preferably multicentre, studies are needed (for all artificial intelligence-derived software technologies) that evaluate these technologies as they would be implemented in clinical practice. Study registration: This study is registered as PROSPERO CRD42021269609. Funding: This award was funded by the National Institute for Health and Care Research (NIHR) Evidence Synthesis programme (NIHR award ref: NIHR133836) and is published in full in Health Technology Assessment; Vol. 28, No. 11. See the NIHR Funding and Awards website for further award information.
- Open Access
- 9 January 2024
- Published by Springer Nature in PharmacoEconomics
- Vol. 42 (4) , 419-434
Exploring the Cost Effectiveness of a Whole-Genome Sequencing-Based Biomarker for Treatment Selection in Patients with Advanced Lung Cancer Ineligible for Targeted Therapy
Objective We aimed to perform an early cost-effectiveness analysis of using a whole-genome sequencing-based tumor mutation burden (WGS-TMB), instead of programmed death-ligand 1 (PD-L1), for immunotherapy treatment selection in patients with non-squamous advanced/metastatic non-small cell lung cancer ineligible for targeted therapy, from a Dutch healthcare perspective. Methods A decision-model simulating individual patients with metastatic non-small cell lung cancer was used to evaluate diagnostic strategies to select first-line immunotherapy only or the immunotherapy plus chemotherapy combination. Treatment was selected using PD-L1 [A, current practice], WGS-TMB [B], and both PD-L1 and WGS-TMB [C]. Strategies D, E, and F take into account a patient’s disease burden, in addition to PD-L1, WGS-TMB, and both PD-L1 and WGS-TMB, respectively. Disease burden was defined as a fast-growing tumor, a high number of metastases, and/or weight loss. A threshold of 10 mutations per mega-base was used to classify patients into TMB-high and TMB-low groups. Outcomes were discounted quality-adjusted life-years (QALYs) and healthcare costs measured from the start of first-line treatment to death. Healthcare costs includes drug acquisition, follow-up costs, and molecular diagnostic tests (i.e., standard diagnostic techniques and/or WGS for strategies involving TMB). Results were reported using the net monetary benefit at a willingness-to-pay threshold of €80,000/QALY. Additional scenario and threshold analyses were performed. Results Strategy B had the lowest QALYs (1.84) and lowest healthcare costs (€120,800). The highest QALYs and healthcare costs were 2.00 and €140,400 in strategy F. In the base-case analysis, strategy A was cost effective with the highest net monetary benefit (€27,300), followed by strategy B (€26,700). Strategy B was cost effective when the cost of WGS testing was decreased by at least 24% or when immunotherapy results in an additional 0.5 year of life gained or more for TMB high compared with TMB low. Strategies C and F, which combined TMB and PD-L1 had the highest net monetary benefit (≥ €76,900) when the cost of WGS testing, immunotherapy, and chemotherapy acquisition were simultaneously reduced by at least 47%, 39%, and 43%, respectively. Furthermore, strategy C resulted in the highest net monetary benefit (≥ €39,900) in a scenario where patients with both PD-L1 low and TMB low were treated with chemotherapy instead of immunotherapy plus chemotherapy. Conclusions The use of WGS-TMB is not cost effective compared to PD-L1 for immunotherapy treatment selection in non-squamous metastatic non-small cell lung cancer in the Netherlands. WGS-TMB could become cost effective provided there is a reduction in the cost of WGS testing or there is an increase in the predictive value of WGS-TMB for immunotherapy effectiveness. Alternatively, a combination strategy of PD-L1 testing with WGS-TMB would be cost effective if used to support the choice to withhold immunotherapy in patients with a low expected benefit of immunotherapy.
- 9 January 2024
- Published by Springer Nature in PharmacoEconomics
- Vol. 42 (4) , 419-434
Open AccessExploring the Cost Effectiveness of a Whole-Genome Sequencing-Based Biomarker for Treatment Selection in Patients with Advanced Lung Cancer Ineligible for Targeted Therapy
Objective We aimed to perform an early cost-effectiveness analysis of using a whole-genome sequencing-based tumor mutation burden (WGS-TMB), instead of programmed death-ligand 1 (PD-L1), for immunotherapy treatment selection in patients with non-squamous advanced/metastatic non-small cell lung cancer ineligible for targeted therapy, from a Dutch healthcare perspective. Methods A decision-model simulating individual patients with metastatic non-small cell lung cancer was used to evaluate diagnostic strategies to select first-line immunotherapy only or the immunotherapy plus chemotherapy combination. Treatment was selected using PD-L1 [A, current practice], WGS-TMB [B], and both PD-L1 and WGS-TMB [C]. Strategies D, E, and F take into account a patient’s disease burden, in addition to PD-L1, WGS-TMB, and both PD-L1 and WGS-TMB, respectively. Disease burden was defined as a fast-growing tumor, a high number of metastases, and/or weight loss. A threshold of 10 mutations per mega-base was used to classify patients into TMB-high and TMB-low groups. Outcomes were discounted quality-adjusted life-years (QALYs) and healthcare costs measured from the start of first-line treatment to death. Healthcare costs includes drug acquisition, follow-up costs, and molecular diagnostic tests (i.e., standard diagnostic techniques and/or WGS for strategies involving TMB). Results were reported using the net monetary benefit at a willingness-to-pay threshold of €80,000/QALY. Additional scenario and threshold analyses were performed. Results Strategy B had the lowest QALYs (1.84) and lowest healthcare costs (€120,800). The highest QALYs and healthcare costs were 2.00 and €140,400 in strategy F. In the base-case analysis, strategy A was cost effective with the highest net monetary benefit (€27,300), followed by strategy B (€26,700). Strategy B was cost effective when the cost of WGS testing was decreased by at least 24% or when immunotherapy results in an additional 0.5 year of life gained or more for TMB high compared with TMB low. Strategies C and F, which combined TMB and PD-L1 had the highest net monetary benefit (≥ €76,900) when the cost of WGS testing, immunotherapy, and chemotherapy acquisition were simultaneously reduced by at least 47%, 39%, and 43%, respectively. Furthermore, strategy C resulted in the highest net monetary benefit (≥ €39,900) in a scenario where patients with both PD-L1 low and TMB low were treated with chemotherapy instead of immunotherapy plus chemotherapy. Conclusions The use of WGS-TMB is not cost effective compared to PD-L1 for immunotherapy treatment selection in non-squamous metastatic non-small cell lung cancer in the Netherlands. WGS-TMB could become cost effective provided there is a reduction in the cost of WGS testing or there is an increase in the predictive value of WGS-TMB for immunotherapy effectiveness. Alternatively, a combination strategy of PD-L1 testing with WGS-TMB would be cost effective if used to support the choice to withhold immunotherapy in patients with a low expected benefit of immunotherapy.
- Open Access
- 12 October 2023
- Published by Cambridge University Press (CUP) in International Journal of Technology Assessment in Health Care
- Vol. 39 (1) , 1-6
Response to “UNCERTAINTY MANAGEMENT IN REGULATORY AND HEALTH TECHNOLOGY ASSESSMENT DECISION-MAKING ON DRUGS: GUIDANCE OF THE HTAi-DIA WORKING GROUP”
Decision-Making on Drugs: Guidance of the HTAi-DIA Working Group" by Hogervorst et al. (1). We wish to commend HTAi, DIA, and the Working Group for selecting this important topic. To our surprise, the guidance only references a small subset of the extensive work on the topic of uncertainty in and outside of health technology assessment (HTA). Not referenced were articles on considerations around uncertainty in health (2-7), classifications of uncertainty in HTA (8-11) and outside HTA (12-16), and methods for uncertainty assessment (17-22), among others. For a scientific article in a scientific journal, methods and results of the scoping review are not described in sufficient detail. It remains unclear if and how the state of the art on uncertainty in HTA was used to develop the guidance. Specifically, the part on "building blocks comprising decision-making uncertainty" bears non-negligible similarity to published work that is identified in the authors' scoping review but not citedthe TRUST tool 2020 (11). TRUST considers the same uncertainty factors as outlined in the present article, including origin (location in TRUST), type (source in TRUST), impact/risk (same in TRUST), and relevance/judgment (appraisal in TRUST). The types of actionable uncertainty considered are also very similar: inaccurate (separated into imprecision, bias, and indirectness in TRUST); unavailable (same in TRUST); and non-understandable (transparency in TRUST). In line with existing classifications of uncertainty (8;16), TRUST also considers uncertainty stemming from methodological issues. TRUST does not include uncertainty from conflicting information, as this was considered to be reflected through imprecision or bias (4). TRUST is readily available, validated, practical, and used in practice (e.g., in Dutch Healthcare Institute reports). It is unclear how the presented guidance improves upon this. There is an opportunity to build upon the challenges other researchers in the area of uncertainty assessment in and outside of HTA have identified and the methods proposed to address these. The progress made on the following topics has not been sufficiently covered in the guidance, including but not limited to:
- 12 October 2023
- Published by Cambridge University Press (CUP) in International Journal of Technology Assessment in Health Care
- Vol. 39 (1) , 1-6
Open AccessResponse to “UNCERTAINTY MANAGEMENT IN REGULATORY AND HEALTH TECHNOLOGY ASSESSMENT DECISION-MAKING ON DRUGS: GUIDANCE OF THE HTAi-DIA WORKING GROUP”
Decision-Making on Drugs: Guidance of the HTAi-DIA Working Group" by Hogervorst et al. (1). We wish to commend HTAi, DIA, and the Working Group for selecting this important topic. To our surprise, the guidance only references a small subset of the extensive work on the topic of uncertainty in and outside of health technology assessment (HTA). Not referenced were articles on considerations around uncertainty in health (2-7), classifications of uncertainty in HTA (8-11) and outside HTA (12-16), and methods for uncertainty assessment (17-22), among others. For a scientific article in a scientific journal, methods and results of the scoping review are not described in sufficient detail. It remains unclear if and how the state of the art on uncertainty in HTA was used to develop the guidance. Specifically, the part on "building blocks comprising decision-making uncertainty" bears non-negligible similarity to published work that is identified in the authors' scoping review but not citedthe TRUST tool 2020 (11). TRUST considers the same uncertainty factors as outlined in the present article, including origin (location in TRUST), type (source in TRUST), impact/risk (same in TRUST), and relevance/judgment (appraisal in TRUST). The types of actionable uncertainty considered are also very similar: inaccurate (separated into imprecision, bias, and indirectness in TRUST); unavailable (same in TRUST); and non-understandable (transparency in TRUST). In line with existing classifications of uncertainty (8;16), TRUST also considers uncertainty stemming from methodological issues. TRUST does not include uncertainty from conflicting information, as this was considered to be reflected through imprecision or bias (4). TRUST is readily available, validated, practical, and used in practice (e.g., in Dutch Healthcare Institute reports). It is unclear how the presented guidance improves upon this. There is an opportunity to build upon the challenges other researchers in the area of uncertainty assessment in and outside of HTA have identified and the methods proposed to address these. The progress made on the following topics has not been sufficiently covered in the guidance, including but not limited to:
- Open Access
- 17 February 2023
- Published by Springer Nature in The International Journal of Cardiovascular Imaging
- Vol. 39 (5) , 915-927
A graphical analysis of aspects contributing to the spreading of measurements of left ventricular function
The Simpson’s method is the standard technique to determine left ventricular (LV) ejection fraction (EF) on echocardiography. The large inter-observer variability of measuring LVEF is well documented but not fully understood. A graphical analysis was used to elaborate what contributes to the inter-observer difference. Forty-two cardiologists (32 male, 39 ± 7 years) evaluated the LVEF using the Simpson’s method on 15 different echocardiograms (2 and 4 chamber view (2CH/4CH)); the program did not show the result of EF to prevent a bias. End-diastolic (ED) and end-systolic (ES) frames were predefined ensuring measurement at the same time point of the cardiac cycles. After standardization of the LV contour, the differences of the individual contours compared to a reference contour were measured. Also, the spreading of lateral/medial mitral annulus contours and the apex were depicted. A significant spreading of LV-contours was seen with larger contours leading to higher EFs (p < 0.001). Experience did not influence the determination of LVEF. ED-volumes showed more spreading than ES-volumes ((3.6 mm (IQR: 2.6–4.0) vs. 3.4 mm (IQR: 2.8–3.8), p < 0.001). Also, the differences were larger for the 2CH compared to the 4CH (p < 0.001). Variability was significantly larger for lateral than septal wall (p < 0.001) as well as the anterior compared to the inferior wall (p < 0.001). There was a relevant scattering of the apex and medial/ lateral mitral annulus ring. There was a large variability of LV-volumes and LVEF as well as position of mitral valve ring and apex. There were global differences (apical 2CH or 4CH), regional aspects (LV walls) and temporal factors (ED vs. ES). Thus, multiple factors contributed to the large variability.Trial registration: The study was registered at “Netherlands Trial Register” (www.trialregister.nl; study number: NL5131).
- 17 February 2023
- Published by Springer Nature in The International Journal of Cardiovascular Imaging
- Vol. 39 (5) , 915-927
Open AccessA graphical analysis of aspects contributing to the spreading of measurements of left ventricular function
The Simpson’s method is the standard technique to determine left ventricular (LV) ejection fraction (EF) on echocardiography. The large inter-observer variability of measuring LVEF is well documented but not fully understood. A graphical analysis was used to elaborate what contributes to the inter-observer difference. Forty-two cardiologists (32 male, 39 ± 7 years) evaluated the LVEF using the Simpson’s method on 15 different echocardiograms (2 and 4 chamber view (2CH/4CH)); the program did not show the result of EF to prevent a bias. End-diastolic (ED) and end-systolic (ES) frames were predefined ensuring measurement at the same time point of the cardiac cycles. After standardization of the LV contour, the differences of the individual contours compared to a reference contour were measured. Also, the spreading of lateral/medial mitral annulus contours and the apex were depicted. A significant spreading of LV-contours was seen with larger contours leading to higher EFs (p < 0.001). Experience did not influence the determination of LVEF. ED-volumes showed more spreading than ES-volumes ((3.6 mm (IQR: 2.6–4.0) vs. 3.4 mm (IQR: 2.8–3.8), p < 0.001). Also, the differences were larger for the 2CH compared to the 4CH (p < 0.001). Variability was significantly larger for lateral than septal wall (p < 0.001) as well as the anterior compared to the inferior wall (p < 0.001). There was a relevant scattering of the apex and medial/ lateral mitral annulus ring. There was a large variability of LV-volumes and LVEF as well as position of mitral valve ring and apex. There were global differences (apical 2CH or 4CH), regional aspects (LV walls) and temporal factors (ED vs. ES). Thus, multiple factors contributed to the large variability.Trial registration: The study was registered at “Netherlands Trial Register” (www.trialregister.nl; study number: NL5131).
- Open Access
- 9 February 2023
- Published by Springer Nature in Scientific Reports
- Vol. 13 (1) , 1-14
Development and validation of a decision model for the evaluation of novel lung cancer treatments in the Netherlands
Recent discoveries in molecular diagnostics and drug treatments have improved the treatment of patients with advanced (inoperable) non-squamous non-small cell lung cancer (NSCLC) from solely platinum-based chemotherapy to more personalized treatment, including targeted therapies and immunotherapies. However, these improvements come at considerable costs, highlighting the need to assess their cost-effectiveness in order to optimize lung cancer care. Traditionally, cost-effectiveness models for the evaluation of new lung cancer treatments were based on the findings of the randomized control trials (RCTs). However, the strict RCT inclusion criteria make RCT patients not representative of patients in the real-world. Patients in RCTs have a better prognosis than patients in a real-world setting. Therefore, in this study, we developed and validated a diagnosis-treatment decision model for patients with advanced (inoperable) non-squamous NSCLC based on real-world data in the Netherlands. The model is a patient-level microsimulation model implemented as discrete event simulation with five health events. Patients are simulated from diagnosis to death, including at most three treatment lines. The base-model (non-personalized strategy) was populated using real-world data of patients treated with platinum-based chemotherapy between 2008 and 2014 in one of six Dutch teaching hospitals. To simulate personalized care, molecular tumor characteristics were incorporated in the model based on the literature. The impact of novel targeted treatments and immunotherapies was included based on published RCTs. To validate the model, we compared survival under a personalized treatment strategy with observed real-world survival. This model can be used for health-care evaluation of personalized treatment for patients with advanced (inoperable) NSCLC in the Netherlands.
- 9 February 2023
- Published by Springer Nature in Scientific Reports
- Vol. 13 (1) , 1-14
Open AccessDevelopment and validation of a decision model for the evaluation of novel lung cancer treatments in the Netherlands
Recent discoveries in molecular diagnostics and drug treatments have improved the treatment of patients with advanced (inoperable) non-squamous non-small cell lung cancer (NSCLC) from solely platinum-based chemotherapy to more personalized treatment, including targeted therapies and immunotherapies. However, these improvements come at considerable costs, highlighting the need to assess their cost-effectiveness in order to optimize lung cancer care. Traditionally, cost-effectiveness models for the evaluation of new lung cancer treatments were based on the findings of the randomized control trials (RCTs). However, the strict RCT inclusion criteria make RCT patients not representative of patients in the real-world. Patients in RCTs have a better prognosis than patients in a real-world setting. Therefore, in this study, we developed and validated a diagnosis-treatment decision model for patients with advanced (inoperable) non-squamous NSCLC based on real-world data in the Netherlands. The model is a patient-level microsimulation model implemented as discrete event simulation with five health events. Patients are simulated from diagnosis to death, including at most three treatment lines. The base-model (non-personalized strategy) was populated using real-world data of patients treated with platinum-based chemotherapy between 2008 and 2014 in one of six Dutch teaching hospitals. To simulate personalized care, molecular tumor characteristics were incorporated in the model based on the literature. The impact of novel targeted treatments and immunotherapies was included based on published RCTs. To validate the model, we compared survival under a personalized treatment strategy with observed real-world survival. This model can be used for health-care evaluation of personalized treatment for patients with advanced (inoperable) NSCLC in the Netherlands.
- Open Access
- 11 November 2022
- Published by Elsevier in Radiotherapy and Oncology
- Vol. 183, 109417
Cost-effectiveness of proton radiotherapy versus photon radiotherapy for non-small cell lung cancer patients: Exploring the model-based approach
- 11 November 2022
- Published by Elsevier in Radiotherapy and Oncology
- Vol. 183, 109417
Open AccessCost-effectiveness of proton radiotherapy versus photon radiotherapy for non-small cell lung cancer patients: Exploring the model-based approach
- Open Access
- 4 October 2021
- Published by Elsevier in Radiotherapy and Oncology
- Vol. 164, 163-166
Association of different fractionation schedules for prophylactic cranial irradiation with toxicity and brain metastases-free survival in stage III non-small cell lung cancer: A pooled analysis of individual patient data from three randomized trials
- 4 October 2021
- Published by Elsevier in Radiotherapy and Oncology
- Vol. 164, 163-166
Open AccessAssociation of different fractionation schedules for prophylactic cranial irradiation with toxicity and brain metastases-free survival in stage III non-small cell lung cancer: A pooled analysis of individual patient data from three randomized trials