Examination of Wording Effect of the TIMSS 2015 Mathematical Self-Esteem Scale Through the Bifactor Models
- 10 June 2021
- journal article
- research article
- Published by International Journal of Assessment Tools in Education in International Journal of Assessment Tools in Education
- Vol. 8 (2) , 326-341
Abstract
The aim of this study is to examine whether or not the positive and negative items in the Mathematical Self-Confidence Scale employed in TIMSS 2015 lead to wording effect. While examining whether the expression effect is present or not, analyzes were conducted both on the general sample and on a separate sample for female and male students. To this end, data of 5724 students from Turkey who participated in TIMSS 2015 were used. Six different measurement models were created in the analysis of data and tested with Confirmatory Factor Analysis. The study revealed that positive items have a higher mean than the negative ones. In addition, it was concluded that the bifactor models fit the data better compared to the traditional DFA model, in which the model where negative items were taken as a separate factor are those that best fit the data. This situation is verified both in the general sample and the subgroups of females and males. In conclusion, it is recommended that the scale items should be created carefully and whether the positive and negative items result in separate factors should be examined.Keywords
This publication has 37 references indexed in Scilit:
- Method Effects and the Meaning of MeasurementFrontiers in Psychology, 2013
- Reversed item bias: An integrative model.Psychological Methods, 2013
- Cross-Cultural Evaluation of Item Wording Effects on an Attitudinal ScaleJournal of Psychoeducational Assessment, 2012
- Bifactor Models and Rotations: Exploring the Extent to Which Multidimensional Data Yield Univocal Scale ScoresJournal of Personality Assessment, 2010
- Social Desirability Bias2010
- Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternativesStructural Equation Modeling: A Multidisciplinary Journal, 1999
- Rosenberg's self‐esteem scale: Two factors or method effectsStructural Equation Modeling: A Multidisciplinary Journal, 1999
- The Effect of Negation and Polar Opposite Item Reversals on Questionnaire Reliability and Validity: An Experimental InvestigationEducational and Psychological Measurement, 1991
- Factors Defined by Negatively Keyed Items: The Result of Careless Respondents?Applied Psychological Measurement, 1985
- Confirmatory factor analysis of the Job Diagnostic Survey: Good news and bad news.Journal of Applied Psychology, 1985