Estimating Trait and Situational Variance in a Situational Judgment Test
Authors:
- 2 January 2009
- journal article
- research article
- Published by Taylor & Francis in Human Performance
- Vol. 22 (1) , 44-63
Abstract
In organizational research, situational judgment tests (SJTs) consistently demonstrate incremental validity, yet our theoretical understanding of SJTs is limited. Our knowledge could be advanced by decomposing the variance of SJT items into trait variance and situation variance; we do that by applying statistical methods used to analyze multitrait–multimethod matrices. A college-student sample (N = 2,747) was administered an SJT of goal orientation traits (i.e., mastery, performance-approach, and performance-avoid). Structural equation modeling was used to estimate the proportions of item variance to attributable to situational differences (across students) and to trait-based differences in students (across situations). Situation factors accounted for over three times the amount of variance as did individual difference factors. We conclude with general implications for the design of SJTs in organizational research.Keywords
This publication has 44 references indexed in Scilit:
- The Role of Goal Orientation on Negative Emotions and Goal Setting When Initial Performance Falls Short of One's Performance GoalHuman Performance, 2005
- A Motivated Action Theory Account of Goal Orientation.Journal of Applied Psychology, 2005
- Goal orientation and ability: Interactive effects on self-efficacy, performance, and knowledge.Journal of Applied Psychology, 2002
- Incremental validity of situational judgment tests.Journal of Applied Psychology, 2001
- The Relation Between Personality and Contextual Performance in "Strong" Versus "Weak" SituationsHuman Performance, 2001
- Goal Orientation in Organizational Research: A Conceptual and Empirical FoundationOrganizational Behavior and Human Decision Processes, 1996
- Classrooms: Goals, structures, and student motivation.Journal of Educational Psychology, 1992
- Comparative fit indexes in structural models.Psychological Bulletin, 1990
- Multiplicative Models and MTMM MatricesJournal of Educational Statistics, 1988
- Significance tests and goodness of fit in the analysis of covariance structures.Psychological Bulletin, 1980