CLChristine Leopold

Christine Leopold

*This is an algorithmically generated author record based on publicly available information.

Current Organizations / Institutes

The organizations/institutes from the scholar's latest article

Previous Organizations / Institutes

The organizations / institutes from the scholar's other articles in the past ten years


Christine Leopold has a total of 92 co-authors. Here are the top co-authors by number of shared publications:

  • Anita K. Wagner

    Division of Health Policy and Insurance Research, Department of Population Medicine, Harvard Medical School and Harvard Pilgrim Health Care Institute, Boston, USA

    8 shared publications
  • Fang Zhang

    Department of Population Medicine, Division of Health Policy and Insurance Research, Harvard Medical School and Harvard Pilgrim Health Care Institute, Landmark Center, 401 Park Drive Suite 401, Boston, MA, 02215, USA

    5 shared publications
  • Larissa Nekhlyudov

    Department of Population Medicine, Division of Health Policy and Insurance Research, Harvard Medical School and Harvard Pilgrim Health Care Institute, Landmark Center, 401 Park Drive Suite 401, Boston, MA, 02215, USA

    5 shared publications
  • Sabine Vogler

    Austrian National Public Health Institute, Austria

    5 shared publications
  • Craig Earle

    Ontario Institute for Cancer Research, Toronto, ON, Canada

    4 shared publications
  • Christine Y. Lu

    Division of Health Policy and Insurance Research, Department of Population Medicine, Harvard Medical School and Harvard Pilgrim Health Care Institute, Landmark Center, 401 Park Drive Suite 401, Boston, MA, 02215, USA

    3 shared publications

Latest Publications

  • Open Access

    Timing and rate of reimbursement for cystic fibrosis modulator therapies in EU countries

    by Enrico Costa, Silvia Girotti, Saif Elayan, Carlo Castellani, Maria Cavaller Bellaubi, Wim Goettsch, Momir Radulović, João Rocha, Pierluigi Russo, Steven Simoens, et al.

  • Open Access

    Repurposing Registries: Completeness of Real‐World Data for Regulatory and HTA Purposes in Three Cancer‐Focused Registries

    by Manon C. Wilpshaar, Doranne Hilarius, Luisa Prada, Ansgar Weltermann, Christine Leopold

    Despite developments in supporting the identification and selection of fit‐for‐purpose registries, a translational gap remains between the original purposes of clinically focused registries and their current and future expected use in policymaking. This study aimed to assess the extent to which cancer‐focused registries collect essential data elements for regulatory and Health Technology Assessment (HTA) processes. Using literature and expert input, a reference dataset of essential data elements was developed. Completeness of data elements in this reference dataset was evaluated on the example of three European, cancer‐focused registries, varying in type, coverage, and health system: the Cancer Centre Upper Austria (CCUA) registry, the Dutch Medication Audit (DMA), and the Portuguese Oncology Institute of Porto (RIC IPO Porto) registry. The evaluated registries exhibit clear differences in inclusion criteria driven by their specific aims. Data elements related to comorbidities, concomitant therapies, patient‐reported outcome measures (PROMs), resource use, and safety outcomes were lacking partly or completely in all evaluated registries, highlighting the importance of developing disease‐specific core datasets to which registry holders can benchmark their data collection. This study also highlights that the initial aims and design of registries impact their strengths and weaknesses in supporting regulatory and HTA decision‐making. Optimally repurposing registry data requires capacity building for registry holders and regulatory/HTA stakeholders focusing on mutual understanding of aims, needs, and limitations. Additional research should address data interoperability, standardization, and data quality across registries.


  • Open Access

    Text mining methods for automated data extraction from health technology assessment reports of medicines using classical natural language processing and generative artificial intelligence

    by Jan-Willem Versteeg, Marie L De Bruin, Maarten Schermer, Shiva Nadi Najafabadi, Modhurita Mitra, Christine Leopold, Aukje K Mantel-Teeuwisse, Wim G Goettsch, Lourens T Bloem

    Objective: This proof of concept for utilizing automatic data extraction methods to extract health technology assessment (HTA) attributes from HTA reports of medicines aimed to explore which attributes could be extracted and how accurately, using different data extraction methods. This enables easy access to insights into HTA recommendations for policymaking and policy-related research. Materials and Methods: In total, 14 relevant attributes (eg, assessment outcome or date) were identified for extraction using two classical natural language processing (NLP) methods (rule-based and classification models) and a generative AI method (large language model (LLM)-based, i.e., Claude 3 Opus). The performance of these techniques was compared using 50 HTA reports published by the National Institute for Health and Care Excellence (NICE, United Kingdom). Results: All three methods were able to extract certain attributes with high accuracy, with differences between the extraction methods and the type of attribute. The LLM-based extraction was the only method able to extract attributes on a medicine-indication combination level. The LLM-based extraction performed best (88–98% semantical accuracy for 12/14 attributes). Extraction of Outcome relative effectiveness analyses (REA) and Comparator was the most challenging and had the lowest accuracy (∼70% for the LLM-based extraction). Discussion & Conclusion: Automatic data extraction for relevant attributes from HTA reports is possible, but there is still room for improvement. LLM-based extraction outperformed the two NLP methods, but challenges regarding the use of commercial software and reproducibility remain. Future research should focus on expanding the system to other HTA organizations and further refining the LLM-based extraction.


  • Open Access

    A multi-stakeholder survey on communicating cost-effectiveness uncertainties to stakeholders: a case study of ICER

    by Jan-Willem Versteeg, Wim G Goettsch, Aukje K Mantel-Teeuwisse, Daniel Ollendorf, Christine Leopold

    Introduction: Cost-effectiveness analyses (CEA) are integral to health technology assessments performed by the US-based Institute for Clinical and Economic Review (ICER). This study aims to examine how stakeholder groups perceive and interpret ICER's communication on uncertainty in CEA findings. Methods: We performed a multi-stakeholder survey among individuals recruited via ICER's weekly update email (March/April 2025). The survey focused on 6 topics related to ICER's uncertainty communication based on the organization's published reference case, consisting of Likert-scale and open-ended questions. Results were analyzed descriptively with thematic analysis of open-ended responses. Results: Thirty-four responses were collected, representing different stakeholder groups. Results indicated that 16/18 of respondents found sensitivity analyses to be communicated clearly (varying by analysis type), while 9/17 found structural and parametric assumptions to be communicated clearly. Most report sections were understandable respondents, and 15/23 found the communication of uncertainty outside reports to be understandable. Thematic analysis identified scenario analyses, structural/parametric uncertainty communication, and stakeholder-tailored communications as areas for future enhancement. Conclusions: While methodological guidelines focus on quantifying uncertainty, limited guidance exists for communicating key facts on uncertainty to different stakeholder groups. This study highlights specific stakeholder-perceived areas for improvement. Future research could compare these results to other organizations.

  • Open Access

    Stakeholders’ experiences with a clinician-led access programme linking evidence generation and reimbursement for precision cancer treatments: the drug access protocol in the Netherlands

    by Christine Leopold, Atse H Huisman, Kevin J. G. M. Vlaar, Haiko J Bloemendal, Sahar Barjesteh van Waalwijk van Doorn-Khosrovani

    Background and purpose: In the current landscape of tumour-agnostic oncology drugs receiving European Medicines Agency (EMA) authorisation, Health Technology Assessment (HTA) bodies face challenges in assessing these innovative drugs. Due to these products’ non-randomised, single-arm nature, uncertainty exists regarding their real-world benefit. In the Netherlands, the Drug Access Protocol (DAP), a programme developed by oncologists, insurers and the healthcare public institute, aims to provide an innovative solution to address this uncertainty. This study aims to investigate the key characteristics, enablers and challenges of the programme by exploring stakeholders’ perceptions.Patient/material and methods: A qualitative, semi-structured interview study was conducted. A supporting interview guide was drafted using available literature and a flowchart figure to illustrate the process. Interviews were conducted with market authorisation holders (MAHs) who participated in the programme, the insurer, the DAP study management and the DAP’s governance committee. Recorded interviews were transcribed, pseudonymised and subsequently coded using NVivo software. Inductive thematic analysis was used to identify common themes, enablers and challenges for participating in the programme.Results: In total, eight organisations were interviewed. Although MAHs indicated several enablers (e.g. providing patient access, collecting real-world data), several challenges (e.g. the lack of transparency) lead to questions regarding the feasibility of the programme. Health insurers acknowledge these outcomes and expect products that obtain regular reimbursement to serve as an example.Interpretation: As the Drug Access Protocol may be a promising solution to mitigate uncertainties for healthcare decision-makers, implementation challenges can hamper its feasibility. Addressing these challenges could realise the potential of such programmes.


  • Open Access

    Coverage with evidence development for medicines with insufficient evidence of clinical benefit: experience from the Netherlands

    by Jan-Willem Versteeg, Noraly Stam, Aukje K. Mantel-Teeuwisse, Lonneke Timmers, Wim Goettsch, Christine Leopold

    Objectives: Since 2019 the Dutch National Healthcare Institute has operated a coverage with evidence development (CED) program for specific products with insufficient evidence of their clinical benefit: orphan medicinal products (OMPs), medicines with conditional marketing authorization (CMA), and medicines with marketing authorization under exceptional circumstances (AEC). The objective of this study is to give an overview of this program and reflect on learnings, challenges, and opportunities. Methods: This study is a narrative policy review of the Dutch CED program and describes the different phases and stakeholder involvement. Additionally, an overview of the medicines included in the CED program is presented and put in an international perspective. Results: The CED program consists of four phases: candidate prescreening, research protocol drafting, signing of process agreement and financial agreement, and controlled access. Stakeholders are involved intensively throughout the process. Since 2019, six medicines have entered the program. The program is used to fill different evidence gaps for various types of medicines and indications. In other countries, these medicines are often included in restricted reimbursement programs. Conclusions: The CED program is gathering clinical effectiveness data while providing patient access to OMPs, CMA, and AEC products. Important facilitating factors for the program were identified, including the involvement of all stakeholders, the only-in-research approach of data gathering, and the case-by-case evidence generation requirements and duration. Continuous evaluation is needed as the program does not yet include the expected number of medicines, and no conclusion can be drawn so far on the usefulness of the data collection.


  • How to Price and to Reimburse Publicly Funded Medicines in Latin America? Lessons Learned from Europe

    by Christine Leopold, Sergio Poblete, Sabine Vogler

    This paper reviews the main pricing policies in Latin American countries, discussing their shortcomings. It also gives an overview of the most common pricing and reimbursement policies in Europe and describes in detail three well-established approaches — international price referencing, value-based pricing, including setting up of health technology assessment, and generic and biosimilar policies — building on country examples.


  • Open Access

    Out-of-Pocket Cancer Care Costs and Value Frameworks: A Case Study in a Community Oncology Practice with a Financial Navigator Program

    by Christine Leopold, Carina Araujo-Lane, Carol Rosenberg, Melissa Gilkey, Anita K. Wagner


  • Open Access

    Integrating public preferences into national reimbursement decisions: a descriptive comparison of approaches in Belgium and New Zealand

    by Christine Leopold, Christine Y. Lu, Anita K. Wagner

    Public health care payer organizations face increasing pressures to make transparent and sustainable coverage decisions about ever more expensive prescription drugs, suggesting a need for public engagement in coverage decisions. However, little is known about countries’ approaches to integrating public preferences in existing funding decisions. The aim of this study was to describe how Belgium and New Zealand used deliberative processes to engage the public and to identify lessons learned from these countries’ approaches. To describe two countries’ deliberative processes, we first reviewed key country policy documents and then conducted semi-structured interviews with five leaders of the processes from Belgium and New Zealand. We assessed each country’s rationales for and approaches to engaging the public in pharmaceutical coverage decisions and identified lessons learned. We used qualitative content analysis of the interviews to describe key themes and subthemes. In both countries, the national public payer organization initiated and led the process of integrating public preferences into national coverage decision making. Reimbursement criteria considered outdated and changing societal expectations prompted the change. Both countries chose a deliberative process of public engagement with a multi-year commitment of many stakeholders to develop new reimbursement processes. Both countries’ new reimbursement processes put a stronger emphasis on quality of life, the separation of individual versus societal perspectives, and the importance of final reimbursement decisions being taken in context rather than based largely on cost-effectiveness thresholds. To face the growing financial pressure of sustainable funding of medicines, Belgium’s and New Zealand’s public payers have developed processes to engage the public in defining the reimbursement system’s priorities. Although these countries differ in context and geographic location, they came up with overlapping lessons learnt which include the need for 1) political commitment to initiate change, 2) broad involvement of all stakeholders, and 3) commitment of all to engage in a long-term process. To evaluate these changes, further research is required to understand how coverage decisions in systems with and without public engagement differ.


  • Open Access

    Expanding Coverage of Oncology Drugs in an Aging, Upper-Middle-Income Country: Analyses of Public and Private Expenditures in Chile

    by Veronica Vargas, Christine Leopold, Marianela Castillo-Riquelme, Jonathan J. Darrow

    PURPOSE The population of Chile has aged, and in 2017, cancer became the leading cause of death. Since 2005, a national health program has expanded coverage of drugs for 13 types of cancer and related palliative care. We describe the trends in public and private oncology drug expenditures in Chile and consider how increasing expenditures might be addressed. METHODS We analyzed total quarterly drug expenditures for 131 oncology drugs from quarter (Q)3 2012 until Q1 2017, including public and private insurance payments and patient out-of-pocket spending. The data were analyzed by drug-mix, sources of funding, growth, and intellectual property status. The Laspeyres Price Index was used to analyze expenditure growth. RESULTS We found 131 oncology drugs associated with 87,129 observations. Spending on drugs rose 120% from the first period, spanning from the first 3 quarters (Q3, Q4, Q1 2012-2013) to the last period (Q3, Q4, Q1 2016-2017), corresponding to an annualized rate of 19.2% and totaling US$398 million (in 2017 dollars). The public sector accounted for 84.2% of spending, which included 50 drugs in the official treatment protocols, whereas private insurance accounted for 7.3% in on-protocol drugs. The remaining 8.5% was paid out of pocket. In the public sector, more than 90% of growth resulted from increased use. Seven drugs, including 3 with nonexpired patents, accounted for 50% of total expenditures. CONCLUSION Increased use and access enabled by expanded public expenditures drove most of the growth in oncology drug expenditures. However, the rate of public expenditure growth may be fiscally unsustainable. Policies are urgently needed to promote the use of generic drugs, the appropriate mix of on-protocol versus offprotocol drugs, and the curbing of off-label prescribing. J Global Oncol. (C) 2019 by American Society of Clinical Oncology