Changing the Scale: The Effect of Modifying Response Scale Labels on the Measurement of Personality and Affect
Authors:
- 2 September 2020
- journal article
- research article
- Published by Taylor & Francis in Multivariate Behavioral Research
- Vol. 57 (1) , 79-93
Abstract
Much research in psychology is based on self-report questionnaire data using items with Likert-type response scales. Often the same items are administered with different response scale labels in different studies. Using measures of personality and affect, the effect of type of label (bipolar or unipolar) on the categorical item responses was investigated with the methods of item response theory (IRT). In two studies, the effect of type of label was examined in the context of all options labeled and only endpoint options labeled. In Study 1, we found that when every number of a response scale is labeled, the responses to the same items differ between bipolar (agree-disagree) and unipolar (not at all – very much) labels. Study 2 showed that these differences are not observed when only the endpoints are labeled. The findings are discussed in terms of their implications for measurement and research reporting of personality, clinical, health, social, and other psychological constructs. IRT methods offer a way to increase our understanding of the psychological processes underlying answering questions.Keywords
This publication has 30 references indexed in Scilit:
- Scale format effects on response option interpretation and useJournal of Business Research, 2016
- Proactive personality and the successful job search: A field investigation with college graduates.Journal of Applied Psychology, 2006
- Implementing a Five-Factor Personality Inventory for Use on the InternetEuropean Journal of Psychological Assessment, 2005
- An item response theory analysis of self-report measures of adult attachment.Journal of Personality and Social Psychology, 2000
- Local Dependence Indexes for Item Pairs Using Item Response TheoryJournal of Educational and Behavioral Statistics, 1997
- An Item Response Theory Analysis of the Rosenberg Self-Esteem ScalePersonality and Social Psychology Bulletin, 1997
- How Meaning Is Given to Rating Scales: The Effects of Response Language on Category ActivationJournal of Experimental Social Psychology, 1996
- Effects of preexisiting beliefs, epistemological beliefs, and need for cognition on interpretation of controversial issues.Journal of Educational Psychology, 1996
- Controlling the False Discovery Rate: A Practical and Powerful Approach to Multiple TestingJournal of the Royal Statistical Society Series B: Statistical Methodology, 1995
- The need for cognition.Journal of Personality and Social Psychology, 1982