Evaluating Country Performance After Transitioning From Gavi Assistance: An Applied Synthetic Control Analysis
Open Access
- 17 August 2023
- journal article
- research article
- Published by Johns Hopkins School Bloomberg School of Public Health, Center for Communication Programs in Global Health: Science and Practice
- Vol. 11 (4) , e2200536
Abstract
Over the past decade, international development assistance for health has slowed. As donors seek to increase domestic cofinancing and ultimately transition countries from donor aid dependence, COVID-19 has severely constrained public budgets. The evaluation of sustainability and longer-term impacts of donor withdrawal is increasingly important. We assess vaccination coverage and post-neonatal mortality to estimate country performance of these outcomes among countries that no longer received assistance from Gavi, the Vaccine Alliance (Gavi) between 2000 and 2018. Using data from all countries receiving Gavi support between 2000 and 2020, we employed a synthetic control method to generate a pre-transition counterfactual with the same characteristics as the observation of interest to predict a future that empirically never existed. The synthetic unit is constructed from the weighted average of other units with good fit to the unit of interest before transition but did not transition. We found substantial heterogeneity after transitioning from Gavi assistance. China, Guyana, and Turkmenistan overperformed their expected coverage rates; Albania, Bhutan, China, Guyana, and Turkmenistan maintained coverage over 90%; and Bosnia and Herzegovina and Ukraine reported precipitous drop-offs that fell well below their synthetic controls. We also observed a vaccination coverage decline in 2020 for several countries after transitioning and most synthetic controls, which we attribute to COVID-19-related service disruptions. We recommend that Gavi adjust its transition model to systematically assess contextual externalities and risk. In addition, countries that no longer receive Gavi assistance can leverage technical assistance and communities of practice to mutually assist each other and other countries advancing toward transition. This could also foster intracountry accountability after transition. We also recommend that Gavi systematize post-transition assessments and evaluations that leverage the expertise and experience of graduated countries to encourage cross-learning.Keywords
This publication has 36 references indexed in Scilit:
- World Health Organization perspectives on the contribution of the Global Alliance for Vaccines and Immunization on reducing child mortalityArchives of Disease in Childhood, 2015
- The GAVI Alliance and the ‘Gates approach’ to health system strengtheningGlobal Public Health, 2014
- Comparative Politics and the Synthetic Control MethodAmerican Journal of Political Science, 2014
- Overcoming challenges to sustainable immunization financing: early experiences from GAVI graduating countriesHealth Policy and Planning, 2014
- Ruggedness: The Blessing of Bad Geography in AfricaReview of Economics and Statistics, 2012
- Measuring impact in the Millennium Development Goal era and beyond: a new approach to large-scale effectiveness evaluationsThe Lancet, 2011
- Synthetic Control Methods for Comparative Case Studies: Estimating the Effect of California’s Tobacco Control ProgramJournal of the American Statistical Association, 2010
- ‘Sustainability’ in global healthGlobal Public Health, 2010
- Vaccine coverage and the GAVI Alliance Immunization Services Support initiativeThe Lancet, 2009
- Disease control priorities in developing countriesChoice Reviews Online, 2006