Video-based versus written situational judgment tests: A comparison in terms of predictive validity.
Authors:
- Filip LievensFLFilip Lievens
- Paul R. SackettPSPaul R. Sackett
Open Access
- 1 September 2006
- journal article
- research article
- Published by American Psychological Association (APA) in Journal of Applied Psychology
- Vol. 91 (5) , 1181-1188
Abstract
In this study, the authors examined whether video-based situational judgment tests (SJTs) have higher predictive validity than written SJTs (keeping verbal content constant). The samples consisted of 1,159 students who completed a video-based version of an SJT and 1,750 students who completed the same SJT in a written format. The study was conducted in a high stakes testing context. The video-based version of an interpersonally oriented SJT had a lower correlation with cognitive ability than did the written version. It also had higher predictive and incremental validity for predicting interpersonally oriented criteria than did the written version. In this high stakes context, applicants also reacted relatively favorably to the SJTs, although there was no significant difference in face validity between the formats. These findings suggest that SJT format changes be made with caution and that validation evidence is needed when changes are proposed.Keywords
This publication has 18 references indexed in Scilit:
- Using SAT-Grade and Ability-Job Performance Relationships to Test Predictions Derived From Stereotype Threat Theory.Journal of Applied Psychology, 2004
- Use of situational judgment tests to predict job performance: A clarification of the literature.Journal of Applied Psychology, 2001
- Examining the impact of administration medium on examinee perceptions and attitudes.Journal of Applied Psychology, 2000
- Correction for range restriction: An expanded typology.Journal of Applied Psychology, 2000
- Why visual and vocal interview cues can affect interviewers' judgments and predict job performance.Journal of Applied Psychology, 1999
- INTERVIEW NOTES AND VALIDITYPersonnel Psychology, 1998
- Validity of Stimulus and Response Components in a Video Test of Social CompetenceInternational Journal of Selection and Assessment, 1998
- VIDEO‐BASED SITUATIONAL TESTINGPersonnel Psychology, 1997
- Sign changes when correcting for range restriction: A note on Pearson's and Lawley's selection formulas.Journal of Applied Psychology, 1994
- The Encoding of Meaning: A Test of Three Theories of Social InteractionSociological Inquiry, 1980