Understanding causal pathways within health systems policy evaluation through mediation analysis: an application to payment for performance (P4P) in Tanzania
Authors:
Open Access
- 2 February 2017
- journal article
- research article
- Published by Springer Nature in Implementation Science
- Vol. 12 (1) , 1-18
Abstract
The evaluation of payment for performance (P4P) programmes has focused mainly on understanding contributions to health service coverage, without unpacking causal mechanisms. The overall aim of the paper is to test the causal pathways through which P4P schemes may (or may not) influence maternal care outcomes. We used data from an evaluation of a P4P programme in Tanzania. Data were collected from a sample of 3000 women who delivered in the 12 months prior to interview and 200 health workers at 150 health facilities from seven intervention and four comparison districts in Tanzania in January 2012 and in February 2013. We applied causal mediation analysis using a linear structural equation model to identify direct and indirect effects of P4P on institutional delivery rates and on the uptake of two doses of an antimalarial drug during pregnancy. We first ran a series of linear difference-in-difference regression models to test the effect of P4P on potential mediators, which we then included in a linear difference-in-difference model evaluating the impact of P4P on the outcome. We tested the robustness of our results to unmeasured confounding using semi-parametric methods. P4P reduced the probability of women paying for delivery care (−4.5 percentage points) which mediates the total effect of P4P on institutional deliveries (by 48%) and on deliveries in a public health facility (by 78%). P4P reduced the stock-out rate for some essential drugs, specifically oxytocin (−36 percentage points), which mediated the total effect of P4P on institutional deliveries (by 22%) and deliveries in a public health facility (by 30%). P4P increased kindness at delivery (5 percentage points), which mediated the effect of P4P on institutional deliveries (by 48%) and on deliveries in a public health facility (by 49%). P4P increased the likelihood of supervision visits taking place within the last 90 days (18 percentage points), which mediated 15% of the total P4P effect on the uptake of two antimalarial doses during antenatal care (IPT2). Kindness during deliveries and the probability of paying out of pocket for delivery care were the mediators most robust to unmeasured confounding. The effect of P4P on institutional deliveries is mediated by financing and human resources factors, while uptake of antimalarials in pregnancy is mediated by governance factors. Further research is required to explore additional and more complex causal pathways.Keywords
Funding Information
- UK AID DFID
This publication has 53 references indexed in Scilit:
- Performance-based financing as a health system reform: mapping the key dimensions for monitoring and evaluationBMC Health Services Research, 2013
- Protocol for the evaluation of a pay for performance programme in Pwani region in Tanzania: A controlled before and after studyImplementation Science, 2013
- Process evaluations for cluster-randomised trials of complex interventions: a proposed framework for design and reportingTrials, 2013
- Paying for performance to improve the delivery of health interventions in low- and middle-income countriesCochrane Database of Systematic Reviews, 2012
- The effect of financial incentives on the quality of health care provided by primary care physiciansCochrane Database of Systematic Reviews, 2011
- Effect on maternal and child health services in Rwanda of payment to primary health-care providers for performance: an impact evaluationThe Lancet, 2011
- A general approach to causal mediation analysis.Psychological Methods, 2010
- Developing and evaluating complex interventions: the new Medical Research Council guidanceBMJ, 2008
- Mediation AnalysisAnnual Review of Psychology, 2007
- The moderator–mediator variable distinction in social psychological research: Conceptual, strategic, and statistical considerations.Journal of Personality and Social Psychology, 1986