Yes, no, maybe so: the importance of cognitive interviewing to enhance structured surveys on respectful maternity care in northern India
Open Access
- 31 October 2019
- journal article
- research article
- Published by Oxford University Press (OUP) in Health Policy and Planning
- Vol. 35 (1) , 67-77
Abstract
Quantitative survey findings are important in measuring health-related phenomena, including on sensitive topics such as respectful maternity care (RMC). But how well do survey results truly capture respondent experiences and opinions? Quantitative tool development and piloting often involve translating questions from other settings and assessing the mechanics of implementation, which fails to deeply explore how respondents understand survey questions and response options. To address this gap, we conducted cognitive interviews on survey questions (n = 88) adapted from validated RMC instruments used in Ethiopia, Kenya and elsewhere in India. Cognitive interviews with rural women (n = 21) in Madhya Pradesh, India involved asking the respondent the survey question, recording her response, then interviewing her about what the question and response options meant to her. We analysed the interviews to revise the tool and identify question failures, which we grouped into six areas: issues with sequencing, length and sensitivity; problematic response options; inappropriate vocabulary; temporal and spatial confusion; accessing different cognitive domains; and failure to resonate with the respondent’s worldview and reality. Although women tended to provide initial answers to the survey questions, cognitive interviews revealed widespread mismatch between respondent interpretation and question intent. Likert scale response options were generally incomprehensible and questions involving hypothetical scenarios could be interpreted in unexpected ways. Many key terms and concepts from the international RMC literature did not translate well and showed low resonance with respondents, including consent and being involved in decisions about one’s care. This study highlights the threat to data quality and the validity of findings when translating quantitative surveys between languages and cultures and showcases the value of cognitive interviews in identifying question failures. While survey tool revision can address many of these issues, further critical discussion is needed on the use of standardized questions to assess the same domains across contexts.Keywords
Funding Information
- Bill and Melinda Gates Foundation (OPP1179252)
This publication has 32 references indexed in Scilit:
- Understanding pregnancy planning in a low-income country setting: validation of the London measure of unplanned pregnancy in MalawiBMC Pregnancy and Childbirth, 2013
- What Do Our Respondents Think We're Asking? Using Cognitive Interviewing to Improve Medical Education SurveysJournal of Graduate Medical Education, 2013
- Why Are Women Dying When They Reach Hospital on Time? A Systematic Review of the ‘Third Delay’PLOS ONE, 2013
- Cognitive testing of the WHOQOL-BREF Bangladesh tool in a northern rural Bangladeshi population with lymphatic filariasisQuality of Life Research, 2013
- Translation and Validation of the Farage Quality of Life (FQoL™) Instrument for Consumer Products into Traditional ChineseGlobal Journal of Health Science, 2012
- Development and preliminary validation of a questionnaire to measure satisfaction with home care in Greece: an exploratory factor analysis of polychoric correlationsBMC Health Services Research, 2010
- Research Synthesis: The Practice of Cognitive InterviewingPublic Opinion Quarterly, 2007
- Evidence of women’s empowerment in India: a study of socio-spatial disparitiesGeoJournal, 2006
- Cognitive Interviewing Revisited: A Useful Technique, in Theory?2004
- Violence against women in health-care institutions: an emerging problemThe Lancet, 2002