Testing the Validity of Gender Ideology Items by Implementing Probing Questions in Web Surveys
Open Access
- 1 November 2012
- journal article
- research article
- Published by SAGE Publications in Field Methods
- Vol. 25 (2) , 124-141
Abstract
This article examines the use of probing techniques in web surveys to identify validity problems of items. Conventional cognitive interviewing is usually based on small sample sizes and thus precludes quantifying the findings in a meaningful way or testing small or special subpopulations characterized by their response behavior. This article investigates probing in web surveys as a supplementary way to look at item validity. Data come from a web survey in which respondents were asked to give reasons for selecting a response category for a closed question. The web study was conducted in Germany, with respondents drawn from online panels (n = 1,023). The usefulness of the proposed approach is shown by revealing validity problems with a gender ideology item.Keywords
This publication has 18 references indexed in Scilit:
- Open-Ended Questions in Web SurveysPublic Opinion Quarterly, 2009
- Sources of Error in Cognitive InterviewsPublic Opinion Quarterly, 2009
- Respondent Debriefings Conducted by Experts: A Technique for Questionnaire EvaluationField Methods, 2009
- The Influence of Topic Interest and Interactive Probing on Responses to Open-Ended Questions in Web SurveysSocial Science Computer Review, 2008
- The Length of Responses to Open-Ended QuestionsSocial Science Computer Review, 2007
- Assessing Data Quality and Construct Comparabilityin Cross-National SurveysEuropean Sociological Review, 2006
- Data Quality in Cognitive Interviews: The Case of Verbal Reports2004
- SURVEY RESEARCHAnnual Review of Psychology, 1999
- Evaluation of Cognitive Interviewing Techniques: Do the Results Generalize to the Field?Bulletin of Sociological Methodology/Bulletin de Méthodologie Sociologique, 1997
- RANDOM PROBES OF GSS QUESTIONSInternational Journal of Public Opinion Research, 1989