Aniek F. Markus
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Aniek F. Markus has a total of 146 co-authors. Here are the top co-authors by number of shared publications:
- Peter R. Rijnbeek
Department of Medical Informatics, Erasmus University Medical Center
6 shared publications Jan A. Kors
Department of Medical Informatics, Erasmus University Medical Center, Rotterdam, the Netherlands
4 shared publications- Jan A. Kors
Department of Medical Informatics Erasmus University Medical Center Rotterdam The Netherlands
4 shared publications Peter R. Rijnbeek
Department of Medical Informatics, Erasmus University Medical Center, Rotterdam, the Netherlands
4 shared publications- Ross D. Williams
Department of Medical Informatics, Erasmus Medical Center, Rotterdam, Zuid-holland, Netherlands
4 shared publications - Chungsoo Kim
Department of Biomedical Sciences, Graduate School of Ajou University, 164 Worldcup-ro, Suwon, 16499, Republic of Korea
3 shared publications
Latest Publications
- Open Access
- 27 February 2024
- Published by BMJ in BMJ Open Respiratory Research
- Vol. 11 (1) , e002127
Real-world treatment trajectories of adults with newly diagnosed asthma or COPD
Background There is a lack of knowledge on how patients with asthma or chronic obstructive pulmonary disease (COPD) are globally treated in the real world, especially with regard to the initial pharmacological treatment of newly diagnosed patients and the different treatment trajectories. This knowledge is important to monitor and improve clinical practice. Methods This retrospective cohort study aims to characterise treatments using data from four claims (drug dispensing) and four electronic health record (EHR; drug prescriptions) databases across six countries and three continents, encompassing 1.3 million patients with asthma or COPD. We analysed treatment trajectories at drug class level from first diagnosis and visualised these in sunburst plots. Results In four countries (USA, UK, Spain and the Netherlands), most adults with asthma initiate treatment with short-acting ß2 agonists monotherapy (20.8%–47.4% of first-line treatments). For COPD, the most frequent first-line treatment varies by country. The largest percentages of untreated patients (for asthma and COPD) were found in claims databases (14.5%–33.2% for asthma and 27.0%–52.2% for COPD) from the USA as compared with EHR databases (6.9%–15.2% for asthma and 4.4%–17.5% for COPD) from European countries. The treatment trajectories showed step-up as well as step-down in treatments. Conclusion Real-world data from claims and EHRs indicate that first-line treatments of asthma and COPD vary widely across countries. We found evidence of a stepwise approach in the pharmacological treatment of asthma and COPD, suggesting that treatments may be tailored to patients’ needs.
- 27 February 2024
- Published by BMJ in BMJ Open Respiratory Research
- Vol. 11 (1) , e002127
Open AccessReal-world treatment trajectories of adults with newly diagnosed asthma or COPD
Background There is a lack of knowledge on how patients with asthma or chronic obstructive pulmonary disease (COPD) are globally treated in the real world, especially with regard to the initial pharmacological treatment of newly diagnosed patients and the different treatment trajectories. This knowledge is important to monitor and improve clinical practice. Methods This retrospective cohort study aims to characterise treatments using data from four claims (drug dispensing) and four electronic health record (EHR; drug prescriptions) databases across six countries and three continents, encompassing 1.3 million patients with asthma or COPD. We analysed treatment trajectories at drug class level from first diagnosis and visualised these in sunburst plots. Results In four countries (USA, UK, Spain and the Netherlands), most adults with asthma initiate treatment with short-acting ß2 agonists monotherapy (20.8%–47.4% of first-line treatments). For COPD, the most frequent first-line treatment varies by country. The largest percentages of untreated patients (for asthma and COPD) were found in claims databases (14.5%–33.2% for asthma and 27.0%–52.2% for COPD) from the USA as compared with EHR databases (6.9%–15.2% for asthma and 4.4%–17.5% for COPD) from European countries. The treatment trajectories showed step-up as well as step-down in treatments. Conclusion Real-world data from claims and EHRs indicate that first-line treatments of asthma and COPD vary widely across countries. We found evidence of a stepwise approach in the pharmacological treatment of asthma and COPD, suggesting that treatments may be tailored to patients’ needs.
- 21 October 2023
- Published by Springer Nature
- p. 636-659
Semantic Meaningfulness: Evaluating Counterfactual Approaches for Real-World Plausibility and Feasibility
- 21 October 2023
- Published by Springer Nature
- p. 636-659
Semantic Meaningfulness: Evaluating Counterfactual Approaches for Real-World Plausibility and Feasibility
- 16 August 2023
- Published by The R Foundation
TreatmentPatterns: Analyzes Real-World Treatment Patterns of a Study Population of Interest
- 16 August 2023
- Published by The R Foundation
TreatmentPatterns: Analyzes Real-World Treatment Patterns of a Study Population of Interest
- Open Access
- 18 May 2023
- Published by IOS Press
- Vol. 302, 1057-1061
Challenges of Estimating Global Feature Importance in Real-World Health Care Data
Feature importance is often used to explain clinical prediction models. In this work, we examine three challenges using experiments with electronic health record data: computational feasibility, choosing between methods, and interpretation of the resulting explanation. This work aims to create awareness of the disagreement between feature importance methods and underscores the need for guidance to practitioners how to deal with these discrepancies.
- 18 May 2023
- Published by IOS Press
- Vol. 302, 1057-1061
Open AccessChallenges of Estimating Global Feature Importance in Real-World Health Care Data
Feature importance is often used to explain clinical prediction models. In this work, we examine three challenges using experiments with electronic health record data: computational feasibility, choosing between methods, and interpretation of the resulting explanation. This work aims to create awareness of the disagreement between feature importance methods and underscores the need for guidance to practitioners how to deal with these discrepancies.
- Open Access
- 21 August 2022
- Published by Elsevier in Computer Methods and Programs in Biomedicine
- Vol. 225, 107081
TreatmentPatterns: An R package to facilitate the standardized development and analysis of treatment patterns across disease domains
- 21 August 2022
- Published by Elsevier in Computer Methods and Programs in Biomedicine
- Vol. 225, 107081
Open AccessTreatmentPatterns: An R package to facilitate the standardized development and analysis of treatment patterns across disease domains
- Open Access
- 29 July 2022
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Technology and Society
- Vol. 3 (4) , 272-289
Assessing Trustworthy AI in Times of COVID-19: Deep Learning for Predicting a Multiregional Score Conveying the Degree of Lung Compromise in COVID-19 Patients
The paper’s main contributions are twofold: to demonstrate how to apply the general European Union’s High-Level Expert Group’s (EU HLEG) guidelines for trustworthy AI in practice for the domain of healthcare; and to investigate the research question of what does “trustworthy AI” mean at the time of the COVID-19 pandemic. To this end, we present the results of a post-hoc self-assessment to evaluate the trustworthiness of an AI system for predicting a multi-regional score conveying the degree of lung compromise in COVID-19 patients, developed and verified by an interdisciplinary team with members from academia, public hospitals, and industry in time of pandemic. The AI system aims to help radiologists to estimate and communicate the severity of damage in a patient’s lung from Chest X-rays. It has been experimentally deployed in the radiology department of the ASST Spedali Civili clinic in Brescia (Italy) since December 2020 during pandemic time. The methodology we have applied for our post-hoc assessment, called Z-Inspection, uses socio-technical scenarios to identify ethical, technical and domain-specific issues in the use of the AI system in the context of the pandemic.
- 29 July 2022
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Technology and Society
- Vol. 3 (4) , 272-289
Open AccessAssessing Trustworthy AI in Times of COVID-19: Deep Learning for Predicting a Multiregional Score Conveying the Degree of Lung Compromise in COVID-19 Patients
The paper’s main contributions are twofold: to demonstrate how to apply the general European Union’s High-Level Expert Group’s (EU HLEG) guidelines for trustworthy AI in practice for the domain of healthcare; and to investigate the research question of what does “trustworthy AI” mean at the time of the COVID-19 pandemic. To this end, we present the results of a post-hoc self-assessment to evaluate the trustworthiness of an AI system for predicting a multi-regional score conveying the degree of lung compromise in COVID-19 patients, developed and verified by an interdisciplinary team with members from academia, public hospitals, and industry in time of pandemic. The AI system aims to help radiologists to estimate and communicate the severity of damage in a patient’s lung from Chest X-rays. It has been experimentally deployed in the radiology department of the ASST Spedali Civili clinic in Brescia (Italy) since December 2020 during pandemic time. The methodology we have applied for our post-hoc assessment, called Z-Inspection, uses socio-technical scenarios to identify ethical, technical and domain-specific issues in the use of the AI system in the context of the pandemic.
- Open Access
- 1 March 2022
- Published by Elsevier in European Journal of Operational Research
- Vol. 297 (3) , 977-985
Eliminating transplant waiting time inequities – With an application to kidney allocation in the USA
- 1 March 2022
- Published by Elsevier in European Journal of Operational Research
- Vol. 297 (3) , 977-985
Open AccessEliminating transplant waiting time inequities – With an application to kidney allocation in the USA
- Open Access
TreatmentPatterns: An R package to analyze treatment patterns of a study population of interest
Background and objectives There is an increasing interest to use real-world data to illustrate how patients with specific medical conditions are treated in real life. Insight in the current treatment practices helps to improve and tailor patient care. We aim to provide an easy tool to support the development and analysis of treatment pathways for a wide variety of medical conditions. Methods We formally defined the process of constructing treatment pathways and developed an open-source R package TreatmentPatterns (https://github.com/mi-erasmusmc/TreatmentPatterns) to enable a reproducible and timely analysis of treatment patterns. Results The developed package supports the analysis of treatment patterns of specific populations of interest. We demonstrate the functionality of the package by analyzing the treatment patterns of three common chronic diseases (type II diabetes mellitus, hypertension, and depression) in the Dutch Integrated Primary Care Information (IPCI) database. Conclusion TreatmentPatterns is a tool to make the analysis of treatment patterns more accessible, more standardized, and more interpretation friendly. This tool can facilitate and contribute to the accumulation of knowledge on real-world treatment patterns across disease domains. We encourage researchers to further adjust and add custom analysis to the package based on their research needs.
Open AccessTreatmentPatterns: An R package to analyze treatment patterns of a study population of interest
Background and objectives There is an increasing interest to use real-world data to illustrate how patients with specific medical conditions are treated in real life. Insight in the current treatment practices helps to improve and tailor patient care. We aim to provide an easy tool to support the development and analysis of treatment pathways for a wide variety of medical conditions. Methods We formally defined the process of constructing treatment pathways and developed an open-source R package TreatmentPatterns (https://github.com/mi-erasmusmc/TreatmentPatterns) to enable a reproducible and timely analysis of treatment patterns. Results The developed package supports the analysis of treatment patterns of specific populations of interest. We demonstrate the functionality of the package by analyzing the treatment patterns of three common chronic diseases (type II diabetes mellitus, hypertension, and depression) in the Dutch Integrated Primary Care Information (IPCI) database. Conclusion TreatmentPatterns is a tool to make the analysis of treatment patterns more accessible, more standardized, and more interpretation friendly. This tool can facilitate and contribute to the accumulation of knowledge on real-world treatment patterns across disease domains. We encourage researchers to further adjust and add custom analysis to the package based on their research needs.
- Open Access
Use of unstructured text in prognostic clinical prediction models: a systematic review
Objective This systematic review aims to assess how information from unstructured clinical text is used to develop and validate prognostic risk prediction models. We summarize the prediction problems and methodological landscape and assess whether using unstructured clinical text data in addition to more commonly used structured data improves the prediction performance. Materials and Methods We searched Embase, MEDLINE, Web of Science, and Google Scholar to identify studies that developed prognostic risk prediction models using unstructured clinical text data published in the period from January 2005 to March 2021. Data items were extracted, analyzed, and a meta-analysis of the model performance was carried out to assess the added value of text to structured-data models. Results We identified 126 studies that described 145 clinical prediction problems. Combining text and structured data improved model performance, compared to using only text or only structured data. In these studies, a wide variety of dense and sparse numeric text representations were combined with both deep learning and more traditional machine learning methods. External validation, public availability, and explainability of the developed models was limited. Conclusion Overall, the use of unstructured clinical text data in the development of prognostic prediction models has been found beneficial in addition to structured data in most studies. The EHR text data is a source of valuable information for prediction model development and should not be neglected. We suggest a future focus on explainability and external validation of the developed models, promoting robust and trustworthy prediction models in clinical practice.
Open AccessUse of unstructured text in prognostic clinical prediction models: a systematic review
Objective This systematic review aims to assess how information from unstructured clinical text is used to develop and validate prognostic risk prediction models. We summarize the prediction problems and methodological landscape and assess whether using unstructured clinical text data in addition to more commonly used structured data improves the prediction performance. Materials and Methods We searched Embase, MEDLINE, Web of Science, and Google Scholar to identify studies that developed prognostic risk prediction models using unstructured clinical text data published in the period from January 2005 to March 2021. Data items were extracted, analyzed, and a meta-analysis of the model performance was carried out to assess the added value of text to structured-data models. Results We identified 126 studies that described 145 clinical prediction problems. Combining text and structured data improved model performance, compared to using only text or only structured data. In these studies, a wide variety of dense and sparse numeric text representations were combined with both deep learning and more traditional machine learning methods. External validation, public availability, and explainability of the developed models was limited. Conclusion Overall, the use of unstructured clinical text data in the development of prognostic prediction models has been found beneficial in addition to structured data in most studies. The EHR text data is a source of valuable information for prediction model development and should not be neglected. We suggest a future focus on explainability and external validation of the developed models, promoting robust and trustworthy prediction models in clinical practice.
- Open Access
Trends in the conduct and reporting of clinical prediction model development and validation: a systematic review
Objectives This systematic review aims to provide further insights into the conduct and reporting of clinical prediction model development and validation over time. We focus on assessing the reporting of information necessary to enable external validation by other investigators. Materials and Methods We searched Embase, Medline, Web-of-Science, Cochrane Library and Google Scholar to identify studies that developed one or more multivariable prognostic prediction models using electronic health record (EHR) data published in the period 2009-2019. Results We identified 422 studies that developed a total of 579 clinical prediction models using EHR data. We observed a steep increase over the years in the number of developed models. The percentage of models externally validated in the same paper remained at around 10%. Throughout 2009-2019, for both the target population and the outcome definitions, code lists were provided for less than 20% of the models. For about half of the models that were developed using regression analysis, the final model was not completely presented. Discussion Overall, we observed limited improvement over time in the conduct and reporting of clinical prediction model development and validation. In particular, the prediction problem definition was often not clearly reported, and the final model was often not completely presented. Conclusion Improvement in the reporting of information necessary to enable external validation by other investigators is still urgently needed to increase clinical adoption of developed models.
Open AccessTrends in the conduct and reporting of clinical prediction model development and validation: a systematic review
Objectives This systematic review aims to provide further insights into the conduct and reporting of clinical prediction model development and validation over time. We focus on assessing the reporting of information necessary to enable external validation by other investigators. Materials and Methods We searched Embase, Medline, Web-of-Science, Cochrane Library and Google Scholar to identify studies that developed one or more multivariable prognostic prediction models using electronic health record (EHR) data published in the period 2009-2019. Results We identified 422 studies that developed a total of 579 clinical prediction models using EHR data. We observed a steep increase over the years in the number of developed models. The percentage of models externally validated in the same paper remained at around 10%. Throughout 2009-2019, for both the target population and the outcome definitions, code lists were provided for less than 20% of the models. For about half of the models that were developed using regression analysis, the final model was not completely presented. Discussion Overall, we observed limited improvement over time in the conduct and reporting of clinical prediction model development and validation. In particular, the prediction problem definition was often not clearly reported, and the final model was often not completely presented. Conclusion Improvement in the reporting of information necessary to enable external validation by other investigators is still urgently needed to increase clinical adoption of developed models.