The effects of reverse items on psychometric properties and respondents’ scale scores according to different item reversal strategies
Open Access
- 16 March 2024
- journal article
- research article
- Published by International Journal of Assessment Tools in Education in International Journal of Assessment Tools in Education
- Vol. 11 (1) , 20-38
Abstract
This study aimed to examine the effects of reverse items created with different strategies on psychometric properties and respondents’ scale scores. To this end, three versions of a 10-item scale in the research were developed: 10 positive items were integrated in the first form (Form-P) and five positive and five reverse items in the other two forms. The reverse items in the second and third forms were crafted using antonyms (Form-RA) and negations (Form-RN), respectively. Based on the research results, Form-P was unidimensional, while other forms were two-dimensional. Moreover, although reliability coefficients of all forms were obtained as above .80, the lowest one was acquired for Form-RN. There were strong-positive relationships between students’ scores in the three scale forms. However, the lowest one was estimated between Form-P and Form-RN. Finally, there was a significant difference between the students’ mean scores obtained from Form–RN and other two versions, but the effect size of the said difference was small. In conclusion, all these results indicate that different types of reverse items influence psychometric properties and respondents’ scale scores differently.Keywords
This publication has 62 references indexed in Scilit:
- Item wording effects in self-report measures and reading achievement: Does removing careless respondents help?Studies in Educational Evaluation, 2022
- Cultural Models of Emotions2021
- Evidence-Based Survey Design: The Use of Negatively Worded Items in SurveysPerformance Improvement Journal, 2018
- Item-wording and the dimensionality of the Rosenberg Self-Esteem Scale: do they matter?Personality and Individual Differences, 2003
- Question Wording Effects in the Assessment of Global Self-EsteemEuropean Journal of Psychological Assessment, 2000
- Evaluating the use of exploratory factor analysis in psychological research.Psychological Methods, 1999
- Effects of affective-semantic mode of item presentation in balanced self-report scales: biased construct validity of the Zung Self-rating Depression ScalePsychological Medicine, 1996
- Some normative, reliability, and factor analytic data for the revised UCLA Loneliness scaleJournal of Clinical Psychology, 1988
- Negative item bias in ratings scales for preadolescent children: A cognitive-developmental phenomenon.Developmental Psychology, 1986
- Application of confirmatory factor analysis to the study of self-concept: First- and higher order factor models and their invariance across groups.Psychological Bulletin, 1985