Jane J. Kim
Research Subjects
Jane J. Kim has a total of 173 co-authors. Here are the top co-authors by number of shared publications:
- Emily Annika Burger
Department of Health Management and Health Economics, Oslo University, Oslo, Norway
9 shared publications - Nicole G. Campos
Center for Health Decision Science, Harvard T.H. Chan School of Public Health, Boston, Massachusetts
8 shared publications Stephen Sy
Center for Health Decision Science, Harvard T.H. Chan School of Public Health, Boston, MA, USA
6 shared publicationsSue J. Goldie
From Harvard School of Public Health, Boston, Massachusetts
5 shared publications- Allison Portnoy
Boston University School of Public Health
4 shared publications Catherine Regan
Affiliation Department of Health Policy and Management, Center for Health Decision Science, Harvard T.H. Chan School of Public Health, Boston, Massachusetts, United States of America
4 shared publications
Latest Publications
- Open Access
- 15 October 2026
- Published by SAGE Publications in Medical Decision Making
Why QALY Estimates Differ in Cervical Cancer Screening: An In-Depth Exploration Using CISNET Comparative Modeling
Background: Quality-adjusted life-years (QALYs) are commonly used as a measure for evaluating the value of cancer screening. However, it is often unclear what drives model-based QALY estimates. We examine factors influencing QALY estimates for cervical cancer screening using 4 independent Cancer Intervention and Surveillance Modeling Network (CISNET) models. Methods: We calculated QALYs gained for 5 recommended cervical screening strategies in the United States (varying in test used, start age, interval, and follow-up of screen positives) and compared with no screening. Each model used common US data, standardized inputs for health-related quality of life (HRQoL) weights, and duration of HRQoL losses. We calculated the percentage change in QALYs gained between screening strategies within each model, comparing the least to the most effective screening strategies. Furthermore, we isolated the impact on the total QALYs gained per stage in the screening process (primary tests, repeat tests, colposcopies, and cancer diagnoses). Results: The percentage change in QALYs gained between screening strategies within each model ranged from 47% to 120%. In contrast, life-years gained (LYG) ranged from 1% to 12%. The largest variation in QALY gains was driven by HRQoL assumptions for repeat tests. Sensitivity analyses showed that QALY gains are highly sensitive to the duration of HRQoL losses due to repeat tests and discounting. Conclusions: Despite standardizing disease burden and key inputs, QALYs remained highly sensitive to individual model assumptions. Comparative modelling and providing additional disaggregated outcomes improve transparency, enabling decision makers to more confidently interpret and use model-based evaluations of screening strategies.
- 15 October 2026
- Published by SAGE Publications in Medical Decision Making
Open AccessWhy QALY Estimates Differ in Cervical Cancer Screening: An In-Depth Exploration Using CISNET Comparative Modeling
Background: Quality-adjusted life-years (QALYs) are commonly used as a measure for evaluating the value of cancer screening. However, it is often unclear what drives model-based QALY estimates. We examine factors influencing QALY estimates for cervical cancer screening using 4 independent Cancer Intervention and Surveillance Modeling Network (CISNET) models. Methods: We calculated QALYs gained for 5 recommended cervical screening strategies in the United States (varying in test used, start age, interval, and follow-up of screen positives) and compared with no screening. Each model used common US data, standardized inputs for health-related quality of life (HRQoL) weights, and duration of HRQoL losses. We calculated the percentage change in QALYs gained between screening strategies within each model, comparing the least to the most effective screening strategies. Furthermore, we isolated the impact on the total QALYs gained per stage in the screening process (primary tests, repeat tests, colposcopies, and cancer diagnoses). Results: The percentage change in QALYs gained between screening strategies within each model ranged from 47% to 120%. In contrast, life-years gained (LYG) ranged from 1% to 12%. The largest variation in QALY gains was driven by HRQoL assumptions for repeat tests. Sensitivity analyses showed that QALY gains are highly sensitive to the duration of HRQoL losses due to repeat tests and discounting. Conclusions: Despite standardizing disease burden and key inputs, QALYs remained highly sensitive to individual model assumptions. Comparative modelling and providing additional disaggregated outcomes improve transparency, enabling decision makers to more confidently interpret and use model-based evaluations of screening strategies.
- Open Access
- 6 March 2026
- Published by SAGE Publications in Medical Decision Making
- Vol. 46 (5) , 591-600
Adapting Sexual Behavior Survey Data to Parameterize an Agent-Based Model of Human Papillomavirus (HPV) Transmission
Purpose: Sexual transmission of human papillomavirus (HPV) infection is important for capturing the indirect effects of interventions in mathematical models, but limited data create challenges for reflecting sexual behavior patterns over the lifespan of individuals and across heterogenous populations. We used nationally representative data from the United States to parameterize, calibrate, and validate a heterosexual transmission model of HPV. Methods: Based on sexual behavior data from the National Survey of Family Growth (2011–2019), we categorized respondents into 4 sexual activity categories, using their percentile of cumulative lifetime partners compared with others within their same sex and age group. We modeled probabilistic partnership acquisition and dissolution by age, sex, and sexual activity category. Partnership data were incorporated into an existing agent-based model of HPV transmission in the United States. We calibrated 1) per-partnership HPV transmission and 2) reduced risk of type-specific reinfection from natural immunity to fit age- and type-specific HPV prevalence using the National Health and Nutrition Examination Survey (NHANES 2002–2008). We validated the final model by comparing model-based projections of HPV prevalence against empirical data in the US population before and after widespread HPV vaccination. Results: After calibrating to fit overall HPV prevalence, model validation exercises indicated that the distribution of prevaccine HPV prevalence across sexual activity categories closely matched NHANES estimates. Simulating vaccination rates over 10 y, the model replicated postvaccine NHANES data for prevalence of HPV16. Conclusion: Capturing HPV transmission dynamics requires an understanding of sexual behavior across populations and over time. Defining sexual activity categories based on cumulative lifetime partners can capture patterns of HPV risk over a lifespan to reflect the dynamics of HPV transmission and vaccination. Highlights: Using data from a large national survey, we developed sexual behavior inputs for an agent-based model of HPV transmission. We define 4 heterogenous risk groups using cumulative lifetime sexual behavior for males and females and find we can recreate validation data on both lifetime sexual patterns and age-specific HPV prevalence. Our calibrated model also reproduces early patterns of HPV reduction following HPV vaccine introduction. Modelers seeking to understand the long-term effects of the HPV vaccine should carefully consider the heterogeneity of sexual behavior across groups as well as changes in behavior over the lifespan.
- 6 March 2026
- Published by SAGE Publications in Medical Decision Making
- Vol. 46 (5) , 591-600
Open AccessAdapting Sexual Behavior Survey Data to Parameterize an Agent-Based Model of Human Papillomavirus (HPV) Transmission
Purpose: Sexual transmission of human papillomavirus (HPV) infection is important for capturing the indirect effects of interventions in mathematical models, but limited data create challenges for reflecting sexual behavior patterns over the lifespan of individuals and across heterogenous populations. We used nationally representative data from the United States to parameterize, calibrate, and validate a heterosexual transmission model of HPV. Methods: Based on sexual behavior data from the National Survey of Family Growth (2011–2019), we categorized respondents into 4 sexual activity categories, using their percentile of cumulative lifetime partners compared with others within their same sex and age group. We modeled probabilistic partnership acquisition and dissolution by age, sex, and sexual activity category. Partnership data were incorporated into an existing agent-based model of HPV transmission in the United States. We calibrated 1) per-partnership HPV transmission and 2) reduced risk of type-specific reinfection from natural immunity to fit age- and type-specific HPV prevalence using the National Health and Nutrition Examination Survey (NHANES 2002–2008). We validated the final model by comparing model-based projections of HPV prevalence against empirical data in the US population before and after widespread HPV vaccination. Results: After calibrating to fit overall HPV prevalence, model validation exercises indicated that the distribution of prevaccine HPV prevalence across sexual activity categories closely matched NHANES estimates. Simulating vaccination rates over 10 y, the model replicated postvaccine NHANES data for prevalence of HPV16. Conclusion: Capturing HPV transmission dynamics requires an understanding of sexual behavior across populations and over time. Defining sexual activity categories based on cumulative lifetime partners can capture patterns of HPV risk over a lifespan to reflect the dynamics of HPV transmission and vaccination. Highlights: Using data from a large national survey, we developed sexual behavior inputs for an agent-based model of HPV transmission. We define 4 heterogenous risk groups using cumulative lifetime sexual behavior for males and females and find we can recreate validation data on both lifetime sexual patterns and age-specific HPV prevalence. Our calibrated model also reproduces early patterns of HPV reduction following HPV vaccine introduction. Modelers seeking to understand the long-term effects of the HPV vaccine should carefully consider the heterogeneity of sexual behavior across groups as well as changes in behavior over the lifespan.
- Open Access
- 28 August 2023
- Published by Springer Nature in BMC Medicine
- Vol. 21 (1) , 1-14
Global impact and cost-effectiveness of one-dose versus two-dose human papillomavirus vaccination schedules: a comparative modelling analysis
Background: To eliminate cervical cancer as a public health problem, the World Health Organization had recommended routine vaccination of adolescent girls with two doses of the human papillomavirus (HPV) vaccine before sexual initiation. However, many countries have yet to implement HPV vaccination because of financial or logistical barriers to delivering two doses outside the infant immunisation programme. Methods: Using three independent HPV transmission models, we estimated the long-term health benefits and cost-effectiveness of one-dose versus two-dose HPV vaccination, in 188 countries, under scenarios in which one dose of the vaccine gives either a shorter duration of full protection (20 or 30 years) or lifelong protection but lower vaccine efficacy (e.g. 80%) compared to two doses. We simulated routine vaccination with the 9-valent HPV vaccine in 10-year-old girls at 80% coverage for the years 2021–2120, with a 1-year catch-up campaign up to age 14 at 80% coverage in the first year of the programme. Results: Over the years 2021–2120, one-dose vaccination at 80% coverage was projected to avert 115.2 million (range of medians: 85.1–130.4) and 146.8 million (114.1–161.6) cervical cancers assuming one dose of the vaccine confers 20 and 30 years of protection, respectively. Should one dose of the vaccine provide lifelong protection at 80% vaccine efficacy, 147.8 million (140.6–169.7) cervical cancer cases could be prevented. If protection wanes after 20 years, 65 to 889 additional girls would need to be vaccinated with the second dose to prevent one cervical cancer, depending on the epidemiological profiles of the country. Across all income groups, the threshold cost for the second dose was low: from 1.59 (0.14–3.82) USD in low-income countries to 44.83 (3.75–85.64) USD in high-income countries, assuming one dose confers 30-year protection. Conclusions: Results were consistent across the three independent models and suggest that one-dose vaccination has similar health benefits to a two-dose programme while simplifying vaccine delivery, reducing costs, and alleviating vaccine supply constraints. The second dose may become cost-effective if there is a shorter duration of protection from one dose, cheaper vaccine and vaccination delivery strategies, and high burden of cervical cancer.
- 28 August 2023
- Published by Springer Nature in BMC Medicine
- Vol. 21 (1) , 1-14
Open AccessGlobal impact and cost-effectiveness of one-dose versus two-dose human papillomavirus vaccination schedules: a comparative modelling analysis
Background: To eliminate cervical cancer as a public health problem, the World Health Organization had recommended routine vaccination of adolescent girls with two doses of the human papillomavirus (HPV) vaccine before sexual initiation. However, many countries have yet to implement HPV vaccination because of financial or logistical barriers to delivering two doses outside the infant immunisation programme. Methods: Using three independent HPV transmission models, we estimated the long-term health benefits and cost-effectiveness of one-dose versus two-dose HPV vaccination, in 188 countries, under scenarios in which one dose of the vaccine gives either a shorter duration of full protection (20 or 30 years) or lifelong protection but lower vaccine efficacy (e.g. 80%) compared to two doses. We simulated routine vaccination with the 9-valent HPV vaccine in 10-year-old girls at 80% coverage for the years 2021–2120, with a 1-year catch-up campaign up to age 14 at 80% coverage in the first year of the programme. Results: Over the years 2021–2120, one-dose vaccination at 80% coverage was projected to avert 115.2 million (range of medians: 85.1–130.4) and 146.8 million (114.1–161.6) cervical cancers assuming one dose of the vaccine confers 20 and 30 years of protection, respectively. Should one dose of the vaccine provide lifelong protection at 80% vaccine efficacy, 147.8 million (140.6–169.7) cervical cancer cases could be prevented. If protection wanes after 20 years, 65 to 889 additional girls would need to be vaccinated with the second dose to prevent one cervical cancer, depending on the epidemiological profiles of the country. Across all income groups, the threshold cost for the second dose was low: from 1.59 (0.14–3.82) USD in low-income countries to 44.83 (3.75–85.64) USD in high-income countries, assuming one dose confers 30-year protection. Conclusions: Results were consistent across the three independent models and suggest that one-dose vaccination has similar health benefits to a two-dose programme while simplifying vaccine delivery, reducing costs, and alleviating vaccine supply constraints. The second dose may become cost-effective if there is a shorter duration of protection from one dose, cheaper vaccine and vaccination delivery strategies, and high burden of cervical cancer.
- Open Access
- 6 November 2021
- Published by Wiley in International Journal of Cancer
- Vol. 150 (5) , 847-855
Potential effectiveness of a therapeutic HPV intervention campaign in Uganda
Cervical cancer is a major source of morbidity and mortality in Uganda. In addition to prophylactic HPV vaccination, secondary prevention strategies are needed to reduce cancer burden. We evaluated the potential cancer reductions associated with a hypothetical single-contact therapeutic HPV intervention— with 70% coverage and variable efficacy [30-100%]— using a three-stage HPV modeling framework reflecting HPV and cervical cancer burden in Uganda. In the reference case, we assumed prophylactic pre-adolescent HPV vaccination starting in 2020 with 70% coverage. A one-time therapeutic intervention targeting 35-year-old women in 2025 (not age-eligible for prophylactic vaccination) averted 1,801 cervical cancers per 100,000 women over their lifetime (100% efficacy) or 533 cancers per 100,000 (30% efficacy). Benefits were considerably smaller in birth cohorts eligible for prophylactic HPV vaccination (768 cases averted per 100,000 at 100% efficacy). Evaluating the population-level impact over 40 years, we found introduction of a therapeutic intervention in 2025 with 100% efficacy targeted annually to 30-year-old women averted 139,000 incident cervical cancers in Uganda. This benefit was greatly reduced if efficacy was lower (30% efficacy; 41,000 cases averted), introduction was delayed (2040 introduction; 72,000 cases averted) or both (22,000 cases averted). We demonstrate the potential benefits of a single-contact HPV therapeutic intervention in a low-income setting, but show the importance of high therapeutic efficacy and early introduction timing relative to existing prophylactic programs. Reduced benefits from a less efficacious intervention may be somewhat offset if available within a shorter time frame.
- 6 November 2021
- Published by Wiley in International Journal of Cancer
- Vol. 150 (5) , 847-855
Open AccessPotential effectiveness of a therapeutic HPV intervention campaign in Uganda
Cervical cancer is a major source of morbidity and mortality in Uganda. In addition to prophylactic HPV vaccination, secondary prevention strategies are needed to reduce cancer burden. We evaluated the potential cancer reductions associated with a hypothetical single-contact therapeutic HPV intervention— with 70% coverage and variable efficacy [30-100%]— using a three-stage HPV modeling framework reflecting HPV and cervical cancer burden in Uganda. In the reference case, we assumed prophylactic pre-adolescent HPV vaccination starting in 2020 with 70% coverage. A one-time therapeutic intervention targeting 35-year-old women in 2025 (not age-eligible for prophylactic vaccination) averted 1,801 cervical cancers per 100,000 women over their lifetime (100% efficacy) or 533 cancers per 100,000 (30% efficacy). Benefits were considerably smaller in birth cohorts eligible for prophylactic HPV vaccination (768 cases averted per 100,000 at 100% efficacy). Evaluating the population-level impact over 40 years, we found introduction of a therapeutic intervention in 2025 with 100% efficacy targeted annually to 30-year-old women averted 139,000 incident cervical cancers in Uganda. This benefit was greatly reduced if efficacy was lower (30% efficacy; 41,000 cases averted), introduction was delayed (2040 introduction; 72,000 cases averted) or both (22,000 cases averted). We demonstrate the potential benefits of a single-contact HPV therapeutic intervention in a low-income setting, but show the importance of high therapeutic efficacy and early introduction timing relative to existing prophylactic programs. Reduced benefits from a less efficacious intervention may be somewhat offset if available within a shorter time frame.
- 1 September 2021
- Published by Elsevier in International Journal of Cardiology
- Vol. 338, 50-57
Cost-utility analysis of heart surgeries for young adults with severe rheumatic mitral valve disease in India
- 1 September 2021
- Published by Elsevier in International Journal of Cardiology
- Vol. 338, 50-57
Cost-utility analysis of heart surgeries for young adults with severe rheumatic mitral valve disease in India
- Open Access
- 11 March 2021
- Published by Public Library of Science (PLoS) in PLOS Medicine
- Vol. 18 (3) , e1003534
Human papillomavirus vaccination for adults aged 30 to 45 years in the United States: A cost-effectiveness analysis
Background: A nonavalent human papillomavirus (HPV) vaccine has been licensed for use in women and men up to age 45 years in the United States. The cost-effectiveness of HPV vaccination for women and men aged 30 to 45 years in the context of cervical cancer screening practice was evaluated to inform national guidelines. Methods and findings: We utilized 2 independent HPV microsimulation models to evaluate the cost-effectiveness of extending the upper age limit of HPV vaccination in women (from age 26 years) and men (from age 21 years) up to age 30, 35, 40, or 45 years. The models were empirically calibrated to reflect the burden of HPV and related cancers in the US population and used standardized inputs regarding historical and future vaccination uptake, vaccine efficacy, cervical cancer screening, and costs. Disease outcomes included cervical, anal, oropharyngeal, vulvar, vaginal, and penile cancers, as well as genital warts. Both models projected higher costs and greater health benefits as the upper age limit of HPV vaccination increased. Strategies of vaccinating females and males up to ages 30, 35, and 40 years were found to be less cost-effective than vaccinating up to age 45 years, which had an incremental cost-effectiveness ratio (ICER) greater than a commonly accepted upper threshold of $200,000 per quality-adjusted life year (QALY) gained. When including all HPV-related outcomes, the ICER for vaccinating up to age 45 years ranged from $315,700 to $440,600 per QALY gained. Assumptions regarding cervical screening compliance, vaccine costs, and the natural history of noncervical HPV-related cancers had major impacts on the cost-effectiveness of the vaccination strategies. Key limitations of the study were related to uncertainties in the data used to inform the models, including the timing of vaccine impact on noncervical cancers and vaccine efficacy at older ages. Conclusions: Our results from 2 independent models suggest that HPV vaccination for adult women and men aged 30 to 45 years is unlikely to represent good value for money in the US.
- 11 March 2021
- Published by Public Library of Science (PLoS) in PLOS Medicine
- Vol. 18 (3) , e1003534
Open AccessHuman papillomavirus vaccination for adults aged 30 to 45 years in the United States: A cost-effectiveness analysis
Background: A nonavalent human papillomavirus (HPV) vaccine has been licensed for use in women and men up to age 45 years in the United States. The cost-effectiveness of HPV vaccination for women and men aged 30 to 45 years in the context of cervical cancer screening practice was evaluated to inform national guidelines. Methods and findings: We utilized 2 independent HPV microsimulation models to evaluate the cost-effectiveness of extending the upper age limit of HPV vaccination in women (from age 26 years) and men (from age 21 years) up to age 30, 35, 40, or 45 years. The models were empirically calibrated to reflect the burden of HPV and related cancers in the US population and used standardized inputs regarding historical and future vaccination uptake, vaccine efficacy, cervical cancer screening, and costs. Disease outcomes included cervical, anal, oropharyngeal, vulvar, vaginal, and penile cancers, as well as genital warts. Both models projected higher costs and greater health benefits as the upper age limit of HPV vaccination increased. Strategies of vaccinating females and males up to ages 30, 35, and 40 years were found to be less cost-effective than vaccinating up to age 45 years, which had an incremental cost-effectiveness ratio (ICER) greater than a commonly accepted upper threshold of $200,000 per quality-adjusted life year (QALY) gained. When including all HPV-related outcomes, the ICER for vaccinating up to age 45 years ranged from $315,700 to $440,600 per QALY gained. Assumptions regarding cervical screening compliance, vaccine costs, and the natural history of noncervical HPV-related cancers had major impacts on the cost-effectiveness of the vaccination strategies. Key limitations of the study were related to uncertainties in the data used to inform the models, including the timing of vaccine impact on noncervical cancers and vaccine efficacy at older ages. Conclusions: Our results from 2 independent models suggest that HPV vaccination for adult women and men aged 30 to 45 years is unlikely to represent good value for money in the US.
- Open Access
- 24 July 2020
- Published by Wiley in International Journal of Cancer
- Vol. 148 (4) , 932-940
Choosing the optimal HPV vaccine: The health impact and economic value of the nonavalent and bivalent HPV vaccines in 48 Gavi‐eligible countries
The human papillomavirus (HPV) vaccines may provide some level of cross‐protection against high‐risk HPV genotypes not directly targeted by the vaccines. We evaluated the long‐term health and economic impacts of routine HPV vaccination using either the nonavalent HPV vaccine or the bivalent HPV vaccine in the context of 48 Gavi‐eligible countries. We used a multi‐modeling approach to compare the bivalent with or without cross‐protection and the nonavalent HPV vaccine. The optimal, that is, most cost‐effective, vaccine was the vaccine with an incremental cost‐effectiveness ratio below the per‐capita gross domestic product (GDP) for each country. By 2100 and assuming 70% HPV vaccination coverage, a bivalent vaccine without cross‐protection, a bivalent vaccine with favorable cross‐protection and the nonavalent vaccine were projected to avert 14.9, 17.2 and 18.5 million cumulative cases of cervical cancer across all 48 Gavi‐eligible countries, respectively. The relative value of the bivalent vaccine compared to the nonavalent vaccine increased assuming a bivalent vaccine conferred high cross‐protection. For example, assuming a cost‐effectiveness threshold of per‐capita GDP, the nonavalent vaccine was optimal in 83% (n = 40) of countries if the bivalent vaccine did not confer cross‐protection; however, the proportion of countries decreased to 63% (n = 30) if the bivalent vaccine conferred high cross‐protection. For lower cost‐effectiveness thresholds, the bivalent vaccine was optimal in a greater proportion of countries, under both cross‐protection assumptions. Although the nonavalent vaccine is projected to avert more cases of cervical cancer, the bivalent vaccine with favorable cross‐protection can prevent a considerable number of cases and would be considered a high‐value vaccine for many Gavi‐eligible countries.
- 24 July 2020
- Published by Wiley in International Journal of Cancer
- Vol. 148 (4) , 932-940
Open AccessChoosing the optimal HPV vaccine: The health impact and economic value of the nonavalent and bivalent HPV vaccines in 48 Gavi‐eligible countries
The human papillomavirus (HPV) vaccines may provide some level of cross‐protection against high‐risk HPV genotypes not directly targeted by the vaccines. We evaluated the long‐term health and economic impacts of routine HPV vaccination using either the nonavalent HPV vaccine or the bivalent HPV vaccine in the context of 48 Gavi‐eligible countries. We used a multi‐modeling approach to compare the bivalent with or without cross‐protection and the nonavalent HPV vaccine. The optimal, that is, most cost‐effective, vaccine was the vaccine with an incremental cost‐effectiveness ratio below the per‐capita gross domestic product (GDP) for each country. By 2100 and assuming 70% HPV vaccination coverage, a bivalent vaccine without cross‐protection, a bivalent vaccine with favorable cross‐protection and the nonavalent vaccine were projected to avert 14.9, 17.2 and 18.5 million cumulative cases of cervical cancer across all 48 Gavi‐eligible countries, respectively. The relative value of the bivalent vaccine compared to the nonavalent vaccine increased assuming a bivalent vaccine conferred high cross‐protection. For example, assuming a cost‐effectiveness threshold of per‐capita GDP, the nonavalent vaccine was optimal in 83% (n = 40) of countries if the bivalent vaccine did not confer cross‐protection; however, the proportion of countries decreased to 63% (n = 30) if the bivalent vaccine conferred high cross‐protection. For lower cost‐effectiveness thresholds, the bivalent vaccine was optimal in a greater proportion of countries, under both cross‐protection assumptions. Although the nonavalent vaccine is projected to avert more cases of cervical cancer, the bivalent vaccine with favorable cross‐protection can prevent a considerable number of cases and would be considered a high‐value vaccine for many Gavi‐eligible countries.
- Open Access
- 19 August 2019
- Published by Springer Nature in BMC Medicine
- Vol. 17 (1) , 1-13
Guidelines for multi-model comparisons of the impact of infectious disease interventions
Despite the increasing popularity of multi-model comparison studies and their ability to inform policy recommendations, clear guidance on how to conduct multi-model comparisons is not available. Herein, we present guidelines to provide a structured approach to comparisons of multiple models of interventions against infectious diseases. The primary target audience for these guidelines are researchers carrying out model comparison studies and policy-makers using model comparison studies to inform policy decisions. The consensus process used for the development of the guidelines included a systematic review of existing model comparison studies on effectiveness and cost-effectiveness of vaccination, a 2-day meeting and guideline development workshop during which mathematical modellers from different disease areas critically discussed and debated the guideline content and wording, and several rounds of comments on sequential versions of the guidelines by all authors. The guidelines provide principles for multi-model comparisons, with specific practice statements on what modellers should do for six domains. The guidelines provide explanation and elaboration of the principles and practice statements as well as some examples to illustrate these. The principles are (1) the policy and research question – the model comparison should address a relevant, clearly defined policy question; (2) model identification and selection – the identification and selection of models for inclusion in the model comparison should be transparent and minimise selection bias; (3) harmonisation – standardisation of input data and outputs should be determined by the research question and value of the effort needed for this step; (4) exploring variability – between- and within-model variability and uncertainty should be explored; (5) presenting and pooling results – results should be presented in an appropriate way to support decision-making; and (6) interpretation – results should be interpreted to inform the policy question. These guidelines should help researchers plan, conduct and report model comparisons of infectious diseases and related interventions in a systematic and structured manner for the purpose of supporting health policy decisions. Adherence to these guidelines will contribute to greater consistency and objectivity in the approach and methods used in multi-model comparisons, and as such improve the quality of modelled evidence for policy.
- 19 August 2019
- Published by Springer Nature in BMC Medicine
- Vol. 17 (1) , 1-13
Open AccessGuidelines for multi-model comparisons of the impact of infectious disease interventions
Despite the increasing popularity of multi-model comparison studies and their ability to inform policy recommendations, clear guidance on how to conduct multi-model comparisons is not available. Herein, we present guidelines to provide a structured approach to comparisons of multiple models of interventions against infectious diseases. The primary target audience for these guidelines are researchers carrying out model comparison studies and policy-makers using model comparison studies to inform policy decisions. The consensus process used for the development of the guidelines included a systematic review of existing model comparison studies on effectiveness and cost-effectiveness of vaccination, a 2-day meeting and guideline development workshop during which mathematical modellers from different disease areas critically discussed and debated the guideline content and wording, and several rounds of comments on sequential versions of the guidelines by all authors. The guidelines provide principles for multi-model comparisons, with specific practice statements on what modellers should do for six domains. The guidelines provide explanation and elaboration of the principles and practice statements as well as some examples to illustrate these. The principles are (1) the policy and research question – the model comparison should address a relevant, clearly defined policy question; (2) model identification and selection – the identification and selection of models for inclusion in the model comparison should be transparent and minimise selection bias; (3) harmonisation – standardisation of input data and outputs should be determined by the research question and value of the effort needed for this step; (4) exploring variability – between- and within-model variability and uncertainty should be explored; (5) presenting and pooling results – results should be presented in an appropriate way to support decision-making; and (6) interpretation – results should be interpreted to inform the policy question. These guidelines should help researchers plan, conduct and report model comparisons of infectious diseases and related interventions in a systematic and structured manner for the purpose of supporting health policy decisions. Adherence to these guidelines will contribute to greater consistency and objectivity in the approach and methods used in multi-model comparisons, and as such improve the quality of modelled evidence for policy.