Why Do Regular and Reversed Items Load on Separate Factors? Response Difficulty vs. Item Extremity
- 2 January 2023
- journal article
- research article
- Published by SAGE Publications in Educational and Psychological Measurement
- Vol. 83 (6) , 1085-1112
Abstract
When constructing measurement scales, regular and reversed items are often used (e.g., “I am satisfied with my job”/“I am not satisfied with my job”). Some methodologists recommend excluding reversed items because they are more difficult to understand and therefore engender a second, artificial factor distinct from the regular-item factor. The current study compares two explanations for why a construct’s dimensionality may become distorted: response difficulty and item extremity. Two types of reversed items were created: negation items (“The conditions of my life are not good”) and polar opposites (“The conditions of my life are bad”), with the former type having higher response difficulty. When extreme wording was used (e.g., “excellent/terrible” instead of “good/bad”), negation items did not load on a factor distinct from regular items, but polar opposites did. Results thus support item extremity over response difficulty as an explanation for dimensionality distortion. Given that scale developers seldom check for extremity, it is unsurprising that regular and polar opposite items often load on distinct factors.Keywords
Funding Information
- Universidade de Macau (MYRG2022-00073-FED)
This publication has 47 references indexed in Scilit:
- Reversed item bias: An integrative model.Psychological Methods, 2013
- I can't get no job satisfaction: Meta‐analysis comparing permanent and contingent workersJournal of Organizational Behavior, 2012
- Evaluation of Parallel Analysis Methods for Determining the Number of FactorsEducational and Psychological Measurement, 2010
- The dirty dozen: A concise measure of the dark triad.Psychological Assessment, 2010
- Testing! testing! one, two, three – Testing the theory in structural equation models!Personality and Individual Differences, 2007
- Deconstructing job satisfactionHuman Resource Management Review, 2002
- The affective and cognitive context of self-reported measures of subjective well-beingSocial Indicators Research, 1993
- The Effect of Negation and Polar Opposite Item Reversals on Questionnaire Reliability and Validity: An Experimental InvestigationEducational and Psychological Measurement, 1991
- Identification of content and style: A two-dimensional interpretation of acquiescence.Psychological Bulletin, 1971
- An index of job satisfaction.Journal of Applied Psychology, 1951