Lotta M. Meijerink
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Previous Organizations / Institutes
The organizations / institutes from the scholar's other articles in the past ten years
Lotta M. Meijerink has a total of 40 co-authors. Here are the top co-authors by number of shared publications:
- Artuur M. Leeuwenberg
Julius Center for Health Sciences and Primary care, University Medical Center Utrecht, Utrecht University, Utrecht, the Netherlands
3 shared publications Ewoud Schuit
Julius Center for Health Sciences and Primary care, University Medical Center Utrecht, Utrecht University, Utrecht, the Netherlands
3 shared publicationsArtuur M. Leeuwenberg
Julius Center for Health Sciences and Primary care, University Medical Center Utrecht, Utrecht University, Utrecht, the Netherlands
2 shared publications- Ewoud Schuit
Julius Center for Health Sciences and Primary care, University Medical Center Utrecht, Utrecht University, Utrecht, the Netherlands
2 shared publications - Jungyeon Choi
Department of Clinical Epidemiology Leiden University Medical Center Leiden the Netherlands
2 shared publications Karel G.M. Moons
University Medical Center Utrecht, The Netherlands
2 shared publications
Latest Publications
- Open Access
- 24 July 2026
- Published by Springer Nature in Diagnostic and Prognostic Research
- Vol. 10 (1) , 20
Treatment effect estimation by comparing observed and predicted outcomes: conditions for valid inference and practical illustration
Background: One non-randomized approach to estimate the average effect of a newly introduced treatment is to compare observed outcomes under the new treatment with predicted outcomes under the standard treatment. These counterfactual predictions are made using a model developed before the new treatment was introduced, using patient characteristics and individualized treatment information. Although the approach has been intuitively applied (e.g., as model-based clinical evaluation in radiotherapy) and can be recognized as a specific case of standardization, a method of virtual controls or a g-method, the theory and conditions required for unbiased treatment effect estimation have not been formally described. The objective of this paper is to formalize the approach and clarify these conditions. Methods: We formalize the approach within the potential outcomes framework for causal inference. We explain the methodology, its necessary conditions, and approaches for assessing their validity. These conditions are furthermore illustrated through a case study from radiotherapy, estimating the benefit of proton therapy compared to photon therapy on dysphagia in patients with head and neck cancer. Results: We describe a set of five sufficient conditions, including examples of violations: transportability, ignorability of treatment assignment, consistency, positivity, and correct model specification. While these conditions are largely untestable, we describe how empirical evidence, such as comparing predicted and observed outcomes in related samples, can increase confidence in their plausibility. Conclusion: When the prediction model predicts well in relevant (sub)populations, the approach can yield unbiased treatment effect estimates. However, there are many possible sources of bias. Therefore, we recommend systematic consideration of all required conditions, informed by domain expertise, and the use of empirical evidence whenever possible to support their plausibility.
- 24 July 2026
- Published by Springer Nature in Diagnostic and Prognostic Research
- Vol. 10 (1) , 20
Open AccessTreatment effect estimation by comparing observed and predicted outcomes: conditions for valid inference and practical illustration
Background: One non-randomized approach to estimate the average effect of a newly introduced treatment is to compare observed outcomes under the new treatment with predicted outcomes under the standard treatment. These counterfactual predictions are made using a model developed before the new treatment was introduced, using patient characteristics and individualized treatment information. Although the approach has been intuitively applied (e.g., as model-based clinical evaluation in radiotherapy) and can be recognized as a specific case of standardization, a method of virtual controls or a g-method, the theory and conditions required for unbiased treatment effect estimation have not been formally described. The objective of this paper is to formalize the approach and clarify these conditions. Methods: We formalize the approach within the potential outcomes framework for causal inference. We explain the methodology, its necessary conditions, and approaches for assessing their validity. These conditions are furthermore illustrated through a case study from radiotherapy, estimating the benefit of proton therapy compared to photon therapy on dysphagia in patients with head and neck cancer. Results: We describe a set of five sufficient conditions, including examples of violations: transportability, ignorability of treatment assignment, consistency, positivity, and correct model specification. While these conditions are largely untestable, we describe how empirical evidence, such as comparing predicted and observed outcomes in related samples, can increase confidence in their plausibility. Conclusion: When the prediction model predicts well in relevant (sub)populations, the approach can yield unbiased treatment effect estimates. However, there are many possible sources of bias. Therefore, we recommend systematic consideration of all required conditions, informed by domain expertise, and the use of empirical evidence whenever possible to support their plausibility.
- Open Access
- 24 April 2026
- Published by Elsevier in Radiotherapy and Oncology
- Vol. 220, 111537
Missing confounding information in counterfactual prediction models: a simulation study on model-based treatment effect evaluation in radiotherapy techniques
- 24 April 2026
- Published by Elsevier in Radiotherapy and Oncology
- Vol. 220, 111537
Open AccessMissing confounding information in counterfactual prediction models: a simulation study on model-based treatment effect evaluation in radiotherapy techniques
- Open Access
Considering causality in normal tissue complication probability model development: a literature review
Background: normal-tissue probability models that estimate the probability of complications often associated with radiotherapy could potentially be used to help clinicians make decisions regarding the radiation dose or the type of radiation treatment. In order to be able to use NTCP models in this way, they should accurately capture the causal relation between dose and complication risk. The question then remains: do current normal-tissue complication probability models for radiation treatment optimization look at causality during model development? Objective: to evaluate the consistency of causal statements in existing NTCP model development studies discussing the relationship between radiation and complications in patients with head and neck cancer. Methods : a comprehensive search by a recent systematic Cochrane review was used to obtain articles reporting on the development and external validation of NTCP models that predicted complications. The full text of all the relevant articles were assessed for: stated aim; claims for potential use; if adjustments for confounding were made; and use of language implying causality. Results: out of the 98 evaluated studies, the minority (11.2%) stated causal aims even though 43.9% of studies made causal recommendations. Overall, 31.6% studies started out with an apparent predictive intent but ended up making causal claims in their conclusion or discussion. Out of all the studies that made causal recommendations there were none that explicitly adjusted for confounding. Conclusion: misalignment between the aims of studies and the interpretation of their results in term of causality is common in observational research of NTCP models for patients with head and neck cancer. Researchers should precisely express their aim; if their aim is to make causal recommendations, they should at least discuss and consider confounding factors when formulating their study design.
Open AccessConsidering causality in normal tissue complication probability model development: a literature review
Background: normal-tissue probability models that estimate the probability of complications often associated with radiotherapy could potentially be used to help clinicians make decisions regarding the radiation dose or the type of radiation treatment. In order to be able to use NTCP models in this way, they should accurately capture the causal relation between dose and complication risk. The question then remains: do current normal-tissue complication probability models for radiation treatment optimization look at causality during model development? Objective: to evaluate the consistency of causal statements in existing NTCP model development studies discussing the relationship between radiation and complications in patients with head and neck cancer. Methods : a comprehensive search by a recent systematic Cochrane review was used to obtain articles reporting on the development and external validation of NTCP models that predicted complications. The full text of all the relevant articles were assessed for: stated aim; claims for potential use; if adjustments for confounding were made; and use of language implying causality. Results: out of the 98 evaluated studies, the minority (11.2%) stated causal aims even though 43.9% of studies made causal recommendations. Overall, 31.6% studies started out with an apparent predictive intent but ended up making causal claims in their conclusion or discussion. Out of all the studies that made causal recommendations there were none that explicitly adjusted for confounding. Conclusion: misalignment between the aims of studies and the interpretation of their results in term of causality is common in observational research of NTCP models for patients with head and neck cancer. Researchers should precisely express their aim; if their aim is to make causal recommendations, they should at least discuss and consider confounding factors when formulating their study design.
- Open Access
- 19 May 2025
- Published by Elsevier in Journal of Clinical Epidemiology
- Vol. 184, 111834
Plug-and-play use of tree-based methods: consequences for clinical prediction modeling
- 19 May 2025
- Published by Elsevier in Journal of Clinical Epidemiology
- Vol. 184, 111834
Open AccessPlug-and-play use of tree-based methods: consequences for clinical prediction modeling
- Open Access
- 9 December 2024
- Published by Elsevier in Journal of Clinical Epidemiology
- Vol. 178, 111636
Updating methods for artificial intelligence–based clinical prediction models: a scoping review
- 9 December 2024
- Published by Elsevier in Journal of Clinical Epidemiology
- Vol. 178, 111636
Open AccessUpdating methods for artificial intelligence–based clinical prediction models: a scoping review
- Open Access
- 6 March 2024
- Published by Springer Nature in BMC Health Services Research
- Vol. 24 (1) , 1-12
Disruption of hospital care during the first year of the COVID-19 pandemic impacted socioeconomic groups differently: population based study using routine registration data
Background: During the COVID-19 pandemic, provision of non-COVID healthcare was recurrently severely disrupted. The objective was to determine whether disruption of non-COVID hospital use, either due to cancelled, postponed, or forgone care, during the first pandemic year of COVID-19 impacted socioeconomic groups differently compared with pre-pandemic use. Methods: National population registry data, individually linked with data of non-COVID hospital use in the Netherlands (2017–2020). in non-institutionalised population of 25–79 years, in standardised household income deciles (1 = low, 10 = high) as proxy for socioeconomic status. Generic outcome measures included patients who received hospital care (dichotomous): outpatient contact, day treatment, inpatient clinic, and surgery. Specific procedures were included as examples of frequently performed elective and acute procedures, e.g.: elective knee/hip replacement and cataract surgery, and acute percutaneous coronary interventions (PCI). Relative risks (RR) for hospital use were reported as outcomes from generalised linear regression models (binomial) with log-link. An interaction term was included to assess whether income differences in hospital use during the pandemic deviated from pre-pandemic use. Results: Hospital use rates declined in 2020 across all income groups. With baseline (2019) higher hospital use rates among lower than higher income groups, relatively stronger declines were found for lower income groups. The lowest income groups experienced a 10% larger decline in surgery received than the highest income group (RR 0.90, 95% CI 0.87 – 0.93). Patterns were similar for inpatient clinic, elective knee/hip replacement and cataract surgery. We found small or no significant income differences for outpatient clinic, day treatment, and acute PCI. Conclusions: Disruption of non-COVID hospital use in 2020 was substantial across all income groups during the acute phases of the pandemic, but relatively stronger for lower income groups than could be expected compared with pre-pandemic hospital use. Although the pandemic’s impact on the health system was unprecedented, healthcare service shortages are here to stay. It is therefore pivotal to realise that lower income groups may be at risk for underuse in times of scarcity.
- 6 March 2024
- Published by Springer Nature in BMC Health Services Research
- Vol. 24 (1) , 1-12
Open AccessDisruption of hospital care during the first year of the COVID-19 pandemic impacted socioeconomic groups differently: population based study using routine registration data
Background: During the COVID-19 pandemic, provision of non-COVID healthcare was recurrently severely disrupted. The objective was to determine whether disruption of non-COVID hospital use, either due to cancelled, postponed, or forgone care, during the first pandemic year of COVID-19 impacted socioeconomic groups differently compared with pre-pandemic use. Methods: National population registry data, individually linked with data of non-COVID hospital use in the Netherlands (2017–2020). in non-institutionalised population of 25–79 years, in standardised household income deciles (1 = low, 10 = high) as proxy for socioeconomic status. Generic outcome measures included patients who received hospital care (dichotomous): outpatient contact, day treatment, inpatient clinic, and surgery. Specific procedures were included as examples of frequently performed elective and acute procedures, e.g.: elective knee/hip replacement and cataract surgery, and acute percutaneous coronary interventions (PCI). Relative risks (RR) for hospital use were reported as outcomes from generalised linear regression models (binomial) with log-link. An interaction term was included to assess whether income differences in hospital use during the pandemic deviated from pre-pandemic use. Results: Hospital use rates declined in 2020 across all income groups. With baseline (2019) higher hospital use rates among lower than higher income groups, relatively stronger declines were found for lower income groups. The lowest income groups experienced a 10% larger decline in surgery received than the highest income group (RR 0.90, 95% CI 0.87 – 0.93). Patterns were similar for inpatient clinic, elective knee/hip replacement and cataract surgery. We found small or no significant income differences for outpatient clinic, day treatment, and acute PCI. Conclusions: Disruption of non-COVID hospital use in 2020 was substantial across all income groups during the acute phases of the pandemic, but relatively stronger for lower income groups than could be expected compared with pre-pandemic hospital use. Although the pandemic’s impact on the health system was unprecedented, healthcare service shortages are here to stay. It is therefore pivotal to realise that lower income groups may be at risk for underuse in times of scarcity.
- Open Access
Trust Issues: Uncertainty Estimation Does Not Enable Reliable OOD Detection On Medical Tabular Data
When deploying machine learning models in high-stakes real-world environments such as health care, it is crucial to accurately assess the uncertainty concerning a model's prediction on abnormal inputs. However, there is a scarcity of literature analyzing this problem on medical data, especially on mixed-type tabular data such as Electronic Health Records. We close this gap by presenting a series of tests including a large variety of contemporary uncertainty estimation techniques, in order to determine whether they are able to identify out-of-distribution (OOD) patients. In contrast to previous work, we design tests on realistic and clinically relevant OOD groups, and run experiments on real-world medical data. We find that almost all techniques fail to achieve convincing results, partly disagreeing with earlier findings.
Open AccessTrust Issues: Uncertainty Estimation Does Not Enable Reliable OOD Detection On Medical Tabular Data
When deploying machine learning models in high-stakes real-world environments such as health care, it is crucial to accurately assess the uncertainty concerning a model's prediction on abnormal inputs. However, there is a scarcity of literature analyzing this problem on medical data, especially on mixed-type tabular data such as Electronic Health Records. We close this gap by presenting a series of tests including a large variety of contemporary uncertainty estimation techniques, in order to determine whether they are able to identify out-of-distribution (OOD) patients. In contrast to previous work, we design tests on realistic and clinically relevant OOD groups, and run experiments on real-world medical data. We find that almost all techniques fail to achieve convincing results, partly disagreeing with earlier findings.