How to do (or not to do) … Assessing the impact of a policy change with routine longitudinal data
Open Access
- 1 January 2011
- journal article
- research article
- Published by Oxford University Press (OUP) in Health Policy and Planning
- Vol. 27 (1) , 76-83
Abstract
A lack of good quality evidence on the effect of alternative social policies in low- and middle-income countries has been recently underlined and the value of randomized trials increasingly advocated. However, it is also acknowledged that randomization is not always feasible or politically acceptable. Analyses using longitudinal data series before and after an intervention can also deliver robust results and such data are often reasonably easy to access.Using the example of evaluating the impact on utilization of a change in health financing policy, this article explains how studies in the literature have often failed to address the possible biases that can arise in a simple analysis of routine longitudinal data. It then describes two possible statistical approaches to estimate impact in a more reliable manner and illustrates in detail the more simple method. Advantages and limitations of this quasi-experimental approach to evaluating the impact of health policies are discussed.Keywords
This publication has 18 references indexed in Scilit:
- Short-term impact of new smoke-free legislation on the utilization of a quitline in Hong KongNicotine & Tobacco Research, 2009
- The impact of user fees on health service utilization in low- and middle-income countries: how strong is the evidence?Bulletin of the World Health Organization, 2008
- What do we mean by rigorous health-systems research?The Lancet, 2008
- Effects of an evidence report and policies lifting reimbursement restrictions for acid suppressants: analysis of the Belgian national databasePharmacoepidemiology and Drug Safety, 2008
- Segmented regression analysis of interrupted time series studies in medication use researchJournal of Clinical Pharmacy and Therapeutics, 2002
- Testing for covariance stationarity of stock returns in the presence of structural breaks: an intervention analysisApplied Economics Letters, 2002
- The fall and rise of cost sharing in Kenya: the impact of phased implementationHealth Policy and Planning, 1996
- Impact of user charges on vulnerable groups: The case of Kibwezi in rural KenyaSocial Science & Medicine, 1995
- Impact of user fees on attendance at a referral centre for sexually transmitted diseases in KenyaThe Lancet, 1992
- Intervention Analysis with Applications to Economic and Environmental ProblemsJournal of the American Statistical Association, 1975