Examining Question and Context Effects in Organization Survey Data Using Item Response Theory
Authors:
- 4 March 2008
- journal article
- research article
- Published by SAGE Publications in Organizational Research Methods
- Vol. 12 (3) , 529-553
Abstract
Organizational researchers routinely use attitudinal surveys to track organizational development and identify areas for intervention. However, seemingly trivial changes to the survey instrument, such as question wording or question order, can introduce measurement artifacts leading to differences in observed responses that are not due to actual employee attitudinal change. Traditional methods for assessing the presence of artifacts because of survey changes require additional survey administration using multiple survey forms and random assignment. However, the item response theory method illustrated in this study eliminates the need for additional data collection, offers a more rigorous design, and requires fewer organizational resources.Keywords
This publication has 38 references indexed in Scilit:
- Context Effects in Attitude SurveysSociological Methods & Research, 2003
- The Effect of Item Parameter Drift on Examinee Ability EstimatesApplied Psychological Measurement, 2002
- The consequences of pairing questions: Context effects in personality measurement.Journal of Personality and Social Psychology, 2001
- HYPOTHESIZING DIFFERENTIAL ITEM FUNCTIONING IN GLOBAL EMPLOYEE OPINION SURVEYSPersonnel Psychology, 2000
- A Comparison of Procedures to Detect Item Parameter DriftApplied Psychological Measurement, 1998
- IRT Differential Item Functioning: An Examination of Ability Scale PurificationsEducational and Psychological Measurement, 1994
- Context and serial-order effects in personality measurement: Limits on the generality of measuring changes the measure.Journal of Personality and Social Psychology, 1994
- Survey Questions About the Frequency of Vaguely Defined Events: The Effects of Response AlternativePublic Opinion Quarterly, 1994
- The Cost of DichotomizationApplied Psychological Measurement, 1983
- Context and Contiguity in Survey QuestionnairesPublic Opinion Quarterly, 1983